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conditions, the models themselvc s im^llo fl h . , parlK ular model to unique local 
t.on measure.. ,„ addit?ort:^rthct ^^^^^^^^^^^^^ 
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SUMMARY 



PURPOSE OF THE HANDBOOK 

The community-based approach to providing; comprehensive mental health services 
offers major promise for preventing and coping with mental illness in children. If school 
personnel-teachers, school administrators, counselors, etcetera-can provide an 
emotionally supportive environment for the developing child, they can help prevent 
mental illness. Community mental health center indirect service programs of consultation 
and community education have been established to provide school personnel with the 
necessary knowledge and skill for preventing mental illness and also for identifying and 
helping children with problems. The indirf»ct use of community mental health center 
resources offers exceptional promise because it provides the broadest practical access to 
the population of developing children and young peopJe. 

Evaluating the effectiveness of CMHC's programs of indirect services to schools is 
severely complicated by the fact that tho mental health worker's efforts are with an 
intermediate agent (e.g., teacher) and not with the eventual b<'neficiary (the child). 
Nevertheless, this evaluation is essential to assure, first, that the most worthwhile 
programs are supported and, second, that continual feedback on ways to improve services 
to the I ubiic is provided. 

Th s handbook, prepared for use in community mental health centers, discusses tht 
process of measuring the relevance and effectiveness of indirect mental health services in 
the schools, and mcludes prototype and sample instruments for such measurement. 



APPROACH TO DEVELOPMENT 

The first phase of the work included visit^s to 11 community mental health centers 
in order to develop detailed information about activities and problems in existing CMHC 
programs of indin^ct services to schools. Then* some 50 interviews were conducted with 
30 consultants who were working in schools. In addition to these interviews, a number of 
administrators and p.sychoIogists in a large, diverse school system were inU»rviewed, and a 
review of school consultation literature was made. 

The second phase focused on defining the main problems of consultation and 
evaluation, and on the developn.ent of the approach to assessment. Finally, the sequential 
stages of consultation were defined, and instruments for assessing the accomplishment of 
intermediate and end goals for each sUige were prepared. 



ASSESSMENT SYSTEM 

The as.se.ssment system that <»merged in the final phase is based on the definition of 
needs and the establishment of objectives. For measurement purposes, these translate 
into: estimating the degree of relevance of the preventive program to existing needs, and 
assessing the processes and results of a preventiv(» program. 

Estimating relevance is accomplished through deUuled examination of the goals for 
action in CMHC indirect s<»rvices m relation to the needs of th(» community and school. 



Assessing a program rests upon the systematic design of instruments for measuring 
the achievement of goals and objectives. Therefore, models were built to aid in establish- 
ing end goals, taking into account the sequential stages and the changing intermediate 
objectives of consultative intervention; decision points and their sub-goals were identified. 
Only after goals are specified is measurement possible. 

Many of the evaluation instruments presented are directly usabie: some are proto- 
types requiring adaptation to the particular needs of the user. The instruments follow 
from the definition of objectives and the progress of consultation through its normal 
stages. 

Models are provided for three types of program consultation (client-cent<?red staff 
development, agency-centered staff development, and project development), with instru- 
ments for assessing each type. These instruments include evaluations to be made by 
consultants and consultees based on expectations, tape records, films, and logs. 

The instruments devised for the Staff Development models will provide information 
on: (a) the attainment of consultee objectives, consultant objectives, and CMHC objec- 
tives, (b) changes in the consultee with regard to problem solving capability and inter- 
personal skill, (c) the characteristics of a particular consultation which limit its effective- 
ness, and (d) changes in policies, functions, and orientation of schools as systi»ms. 

Application of instruments is shown as an example for the Project Development 
model. Other instances of project development would require different instruments to 
reflect the s|)ocific objectives of each project. The system of in.struments for project 
development can be used to produce primary data on client change as well as such 
supplementary data as consultee acquisition of knowledge and skill and system reorienta- 
tion. The example demonstrates the heuristic value of the Project Development model in 
the construction of assessment measures. 

The systematic models of program types of consultation that were devised outline 
the development of a consultation series, and therefore provide a mechanism tor the 
derivation, in stages, of intermediate objectives and final goals. Adaptation of the models 
and the instrument prototypes to local use will provide an orderly means of developing 
measures of various aspects of consultation and achievement of aims. 
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Chapter 1 
INTRmrUCTION 

Purpose and Scope 



During' tho 1960s community mmlal health c(Mit(»r (CMHC) proj,'rams of 
consultation with school professionals ^'ainc^d mom(»ntum as a m(»ans of reaching 
school-a^'ed children in the school setting, and preventing theni from developin^^ 
serious problems. In order to continue improving the effectiven(»ss, growth, and 
community support for CMHC consultation programs it is necessary that (a) the 
programs n»Ievanc(»— to the community, to the school, and to the CMHC— be 
demonstratt»d, and (b) tht? programs effectiven(»ss bt? assessed. Relevanc(» and 
effectiveness are th(» major aspe(*ts of evaluation. 

This handbook is intended for use by the mental health worker who is 
engaged m program consultation to school systems. It provides a guide to the 
development of relevant programs of assistance* and to the evaluation of the 
outcomes of such programs. Chapter 2 presents an approach to the development 
of relevant programs through a study of the community, the school, and CMHC, 
culminating in the joint development of program goals by the school and th<» 
center. Chapter 3, dealing specifically with the a.ssessment of effectiveness, 
describes models for three types of consultation and instrumtMits that may be 
used in assessing instances of the application of each of the models. The three 
models that were developed are: Staff Development--*Client-Centered, Staff 
Development— Agency-Centered, and Project Development. Kach is defined, and 
measures are suggest(»d— both monitoring or progress measures and outcome* 
measures— for as.sessing effects on the consultee (the caregiv(»r— teacher, adminw- 
trator, policeman, clergyman, physician, etc.) or on the caregiving system (the 
school). In a few instances mea,sures are sugg(»sted for th(» eventual recipient of 
the consultation effort, the client (the youth in school). 

None of the instruments pre.sented in Chapter 3 has undergone a us(T trial. 
Therefore, it is most desirable that u.sers of the models and instruments provide 
some reflection of their administrative feasibility for use, usefulness, and .short- 
comings to HumRRO or to the National In.stitute of Mental Health^ to allow 
evaluation and improvement in the systems of assessment. 

'Division of Mental Hedlth Service Program.s, National Institute of Mental Health, or 
HumRRO Divi.sion No 3, Presidio of Monterey, California. 
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Since CMHC consultation programs arc highly diverse and fitted to specific 
community and school problems, in the applicat* " .^articular model it is 
anticipated that some, bu* not necessarily all, in it. ,vul be appropriate for 

direct use. The user is encouraj^t^d to select, modify, and provide his own 
adaptations and innovations to fit specific circumstances. 



Baekjroufui 

Prop-am consultation, for the purpos(^s of th(^ study, was defin(Kl as the 
process of interaction between! mental health workers (consultants) and repre- 
senUitives of another urfjanization (schools) to assist the consultee in planning and 
developing his program, in solving his program problems, and/or, indirectly, 
improving his insights and mental health skills. 

Consultation to schools, a major and int(»gral part of the indirect services 
furnishe ' by a CMHC. developed as a program as a n^sult of the overwhelming 
load of referrals of children to various direct treatment services offered by a 
CMHC. These* referrals for direct treatment far exceoded existing or foreseeable 
resources in CMHCs, In the report of the Joint Commission on Mental Health of 
Children, some of the needs for h(*ip to youth, many of whom are currently untreated 
or only partially treated, are identified: Ten to twelve percent of youth have 
major psychological problems; there are high drop-out rate-: from school among 
poverty-stricken and minority groups; th(Te were three times as many juvenile 
court delinquency cases in 1966 as in 1950, with a rising rate since 1966; there is 
a rapidly rising rate of illegitimate births to teen-age girls; and there are major 
increases in drug use-abuse and v(Mi(»n»al disease. (1 ) 

Indirect services (consultation and education) to those who normally work 
with youth are the most practical and feasible approach toward building a 
collaborative effort that may help to contain this increasing pressure for aid. 
Through a network of consultation to many kinds of caregivers, the mental health 
ca[)abilities and rok^s of teachers and administrators, police, clergy, physicians, and 
oth(»rs are strengthened and the overall effect of CMHC resourctfs is widened. The 
process has additional special value because it can be prevtMitive in character; if 
environmental conditions responsible for psych opathology are successfully 
changed, the need for later direct treatment is appnu iably reduced. Dissemination 
of technique through role modeling, and of principles of mcMital health through 
teaching by mental health professionals is the key component of indirect services. 

Th(» primary recipitnUs of indin^'t S(»rvice are caregivers, hut the eventual 
recipients-the very reason for consultation— are childnMi. This once-removed 
aspect makes the practice of mental health consultation and education at once 
frustrating and challenging and also makes the evaluation of its effectiven(^ss 
difficult. Nevertheless, the promise of consultation is great because of its emphasis 
on prevention. It includes: (a) the development of a large body of caregivers with 
adequate skill in bringing about conditions conducive to child health, (b) the 
establi>,hment of an integrated and collaborative network of practices for provid- 
ing continuous preventive attention and care; (c)a change in public and official 
attitudes an ; .,ophistication about mental health problems; and (d) a growing bjv-e 
for active community support of mental health efforts. (2) 



Background 



The appropriateness of the school as a prime target for consultation servic(\s 
hardly needs amplifying. Regardless of one's personal philosophy about its roles, 
the fact that the school has a tremendous effect on the child is beyond question. 

Schools provide central meeting and caring places for nearly all children— 
culturally deprived, problem-laden, healthy, disturbed, fast learning, slow learning, 
and so forth; schools provide a continuity and stability of caretaking over most of 
a person's vital developmental years; schools provide an accessibility for observa- 
tion, and quick intervention if needed. The school, therefore, provides the most 
likely setting, aside from the home, for preventive planning and action. 

At least two basic considerations of mental health actions are contingent 
upon the presence of adequate i^sessment procedures. First is the ever-increasing 
need to use finite societal resources for programs that are most efficient and 
effective in producing important societal benefits; this need is reflected in increas- 
ingly pressing requirements to justify expensive* programs to legislative and 
administrative funding bodies in terms of their reaults. Second is the fact that 
decisions by CMHCs to modify, discontinue, or replace projects or programs 
should be made on the basis of achievements of objectives and goals. Such 
decisions rc^? ire that effects be assessed. 

There are several reasons for inadequate assessment: (a) the many functions 
and limited resources in CMHCs, resulting in the diffusion of effort over many 
people and purposes, and producing partial commitment to assessment; (b) lack of 
clarity and consensus regarding mental health goals: (c) the feeling that time that 
might be spent in evaluation is better spent in the professional '^doing*' effort: 
(d) lack of skill or orientation in developing explicit short- and long-range objec- 
tives and for relfiting them to measurement procedures; (e) inadequacy of records; 
and (f) the long-range nature of envisioned outcomes which, in many cases, 
precludes adequate follow-up. All these lead to neglect of the evaluation effort. 
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PROGRAM RELEVANCE 

Indirect sorvices to school systems should be related to goals, and goals to 
community and school needs. When iroals are specified, based on needs, there is 
promised assurance that the limited available resources are being used to ameliorate 
relevant problems. No matter how active and innovative a consultation and educa- 
tion program may be, if there is not a demonstrable connection between the needs 
of the community, the aims and needs of the school, and the aims of the CMHC, the 
goals and programs of the consultant r.ay be of little avail. Thus, a crucial aspect of 
overall evaluation is tn>tablishing this sort of relevance. 

Several different levels and facets of relevance and congruence must be con- 
sidered in matching the resources, needs, and goals of the CMHC and its indirect 
services component to the community and the schools. Subsumed under this 
requirement are other necessary congruences and relationships among collaborating 
agencies. Without primary consideration of the schools fundamental needs for 
assistance, mental health service loses meaning; without examination of the collabo- 
rating agencies, goals between agencies may be at odds and efficiency of effort 
reduced. 

In this chapter, a very preliminary approach to the problem of program rele- 
vance is presented. Important aspects of program relevance, defined by the needs 
and goals of those involved, are outhned. All steps suggested would necessarily be 
refined or extended to fit specific local circumstances. 

Ideally, the development of CMHC indirect services in schools would be 
preceded by mutual study and review of the needs and goals of all parties to 
consultation. Reality is often different Many interventions are shaped more by the 
consultant's theoretical and practical predilections, by his desire to cling to familiar 
modes of intervention, and by the practical necessity of beginning new programs in a 
nontnreatening way, than by a systematic study of the characteristics of the school 
and its community. 

Similarly, many school people begin consultation without a clear notion of the 
nature of the process, its potential and promise, or even of their own expectations. 
School people may ent^T consultation more to find a way of transferring the 
management of problem children from the school to the mental health service than 
to gain help in coping with problems. The mutual derivation of realistic goals pro- 
motes cooperation between agencies rather than vying by each for the accomplish- 
ment of parochial goals. 
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Basic Relevance to School/Communitv Needs 



Relevance of programs, then, is a joint responsibility of the school and of the 
mental health center, based on a systematic review of problems, needs, and capabili- 
ties. Insofar as mental health workers are the originators and sole (or main) propo- 
nents of such study, findings may be incomplete and weighted with biases peculiar 
to the particular mental health system. Program planning, program action, and 
program evaluation will be more relevant (and more effective) if they are the prod- 
ucts of joint action and collaboration. Mutual understanding and collaboration 
requires that each agency must bo thoroughly aware of its oum stresses, needs, and 
goals as well as those of it,s collaborator By this means, each agency will be better 
prepared to find common meeting grounds for cooperative action. The remainder of 
this chapter will cover important aspects of program relevance and of congruence of 
efforts and aims. 

The Consultation programs to schools may begin in various ways, some inaus- 
picious. Low budgeting for indirect services, the need to make a non-disruptive entry 
into a school system, the presence in the school of suspicion or misunderstanding of 
consultation aims, are realities that may undermine a climate of cooperative effori in 
setting up mutual goals and self-understanding. Granting these realities and the 
occasional indication for postponement of study of needs, the fact remains that 
consultant-consultee planning in mental health, as in other public health efforts, 
should precede programmed action. 
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Basic Relevance to School/Community Needs 

Fundamental to relevant programs is a survey of those community character- 
istics that are directly reflected in school problems. Table 1 provides a checklist 
which is intended as a flexible guide in identifying and defining problem areas. 
Enumeration and estimation of degree of influence is required in each case. 



Table 1 

Community/School Characteristics 

Community/School Attributes and Needs 

Basic Socro-Economic and Urban-Rural Attributes 

Nutiitfonal ptoblerns. school readniess problemi, school dttendiuico pioblems. low achieve 
ment. language difficulties, gioup interaction problems, eaily affective/cognitive t)lunting. 

Basic Occupational Attributes 

Working mothers, child care problerm.^ student occupational expectations and attitudes, 
academic expectations 

Youth Population Attributes 

Student alrenation. student government prol)lems, occupational expectations, drug use abuse, 
pregnancy and venereal drsease, student attitudes regarding spare time activities, needs of 
gifted 01 average students 



f5#£. - - (Continued) 



Congruence of School-CMHC Aims 



Table 1 (Continued) 
Community/School Characteristics 

Ethnic and Segregatlonal Attributes 

School readiness problems, language problems, ethnic frustration-aggression, rise of militancy, 
early affective/cognitive blunting. 

Welfare Population Attributes 

Nutritional problems, medical problems, fatherless families, working mothers, child-care 
problems, early affective/cognitive blunting. 

Community /School Programs and Services 

Specific Child Programs 
Head Start, pre-schools, child-care facilities, and so forth. 

Handling of Delinquency Problems 

Juvenile courts, probation departments, communuy counselors, educational facilities in 
juvenile holding departments, etc 

t 

Community Agencies, Groups, Programs 
Drug use/abuse centers, PTA, youth centers, community counselors, etc. 



Cofigruenee of Sehool-CMHC Aims 

Prior to development of programs, there is a need for mutual examination of 
school and CMHC policies, facilities, and staff, in order to assure the feasibility and 
appropriateness of planned actions in terms of the characteristics of the involved 
agencies. Even the most ideal program aimed at genuine needs is likely to fail 
without an underlying commitment and adequate facilities on both sides. Crucial 
policy characteristics of schools and of CMHC consultation services are presented 
Tables 2 and 3; these characteristics heavily influence the iy\^i of programs likely to 
succeed. 

CMHC characteristics and policies of the type listed in Table 3 help define the 
services they may be able to fulfill. Characteristics and policies vary greatly from 
center to center. All have prevention as a common core, but approaches range from 
a heavily medically oriented emphasis to great concentration upon social action, and 
from considerable use of indirect service to scant support thereof. A dear review and 
understanding of local indirect services characteristics must be an integral part of 
consultation planning. 

Thus, if a center emphasizes crisis management of breakdowns, consultation 
with school administrators on student participation in school decision making is less 
congruent with CMHC resources and orientation than consultation on crisis manage- 
ment and referral of disturbed children would be. At the same time, if the basic 
defined school need reflects little requirement for crisis management, the CMHC 
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Congruence of School-CMHC Aims 



Table 2 

School Characteristics Influencing Mental Health Programs 

Mental Health Resources in the School 

The number, adequacy, and use of in-school resources such as nurses, psychologists, counselors, 
and special teachers should be explored, as well as ways to augoient their skills and increase 
their utilization. 

School Interaction With Other Agencies 

The adequacy of the relationship with other caregivers-police. probation officers, drug abuse 
centers, community counselors, etc. —should be reviewed. 

School Administrative Climate 

Excessive administrative caution, staff interpersonal conflict, autocratic decision-making, 
attitude toward mental health intervention, and administrative denial of problems should 
all be assessed. 

Teacher and Student Involvement in the School 

The degree of disinterest, apathy, or desire to be out of the school climate, on the part of 
students or teachers, should be reviewed. 

Minority Group Staff Advancement 

Identity and role problems arising from movement of minority members into administrative 
positions should be evaluatecJ. 

School Board Climate 

The realities of school board fiscal and mental health policies, pressure group repre' ♦-tion. 
and board-administration relationships should be clanfisd. 

might profit by reevaluating its goals, orientation, and resources. Along the same 
lines, if a school is characterized with intra-staff conflict, consultation on child 
development is not relevant to the major needs of the school. Or, if a CMHC will 
devote only a limited portion of its budget to indirect services, planning a broad 
consultation program within a school system is not congruent with resources. 
Finally, if a CMHC concentrates on a relatively few neurotic children in a school 
system where ethnic conflicts are great and dropout rates and drug usage are high, its 
activities are not relevant to salient needs in the school/community situation. 

Table 3 

CMHC and Indirect Services Characteristics 
Philosophy of Action 

Although controversy regarding the "medical model" vs. the "social action model" is over- 
simplified, there is need to define the emphasis to be given social action as a method of 
change, 

. (Continued) - — ^ - ____^^= 
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Needs and Problems Identified 



Table 3 fContinued) 

CMHC and Indirect Services Characteristics 

Use of Paid Nonprofessional Workers 

IUhztnT '° TTr'"" .,y counselors, and so forth w.ll be 

utilized requires clarification and specification. 

Attitude Toward Evaluation of Consultation 

^ZZeTZlTT: "1 ^P"-"- 'o -nous 

assessment Degree and type of opposition influence the character of the program Policy 
and attitude must be clarified. Myogram, t'oiicy 

CMHC Support of Indirect Services 

Gaps often exist between original funding plans and final funding for indirect services 
affecting planning, morale, and programs. services. 

Underlying Conceptual Approach 

m^ and" ^rth ' a"^'' 7''"'" '''' ^^-"-^V., child develop- 

ment and so forth. Awareness of approach, and congruence between aims of CMHC and 
consultants are essential to program planning and evaluation. 

Status of Program Planning and Review 

w^lhll'Vnd'rMHC T: °' •^"T"""^'"'""' needs 
wiin scnool and CMHC affect type and range of programs 



Interaction With Other Agencies 



Interaction may range from little or none through equal participation to a position of 

Z~ °' actions.^infiueni;::::;!. 
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Needs and Problems Identified 



Student Problems 
I A. Educational Area 

f 1. learning disabilities 

: 2. School readiness 'problems 

t 3. Early blunting 

I 4. Language problems 

5. Academic problems 



I realities 



^' ^'t^l^^'"^^^'"^ occupational aspirations vs. aspirationai 
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Needs and Problems Identified 



7. The problems of "normal" and "gifted" children 

8. Problems related to physical disabilities 

B. Social Area 

1. Nutritional and medical needs, poor living conditions 

2. Fatherless families, working mothers, child-care problems 

3. Segregational frustration-aggression-militancy 

4. Interaction difficulties 

5. Chronic delinquency, absenteeism 

6. Alienation 

C. Behavioral Crisis Area 

1. Drug use/abuse 

2. Pregnancy, venereal disease 

3. Use of spare time 

4. Mental health breakdown 
II. Curricular Problems 

A. Old-fashioned or inappropriate texts, biased texts, religious texts 

B. Curriculum unrelated to real life such as vocational, human 

relations, work study 

C. Lack of extracurricular activities 

D. Inadequate supplies 

III. Administrative and Staff Problems 

A. Communication problems 

1. Between administration and faculty 

2. Among faculty 

3. Between faculty and students 

4. Between parents, faculty, students 

5. Between school and community 

6. Between school and board 

7. Between school and state and county legislators 

B. Organizational and Administrative problems 

1. Lack of administrative skill 

2. Poor organizational structure 

3. Problems with the size and composition of the student body 

4. Problems with space 

5. Lack of support staff 

6. Lack of appropriate teaching staff 

7. Lack of funding 

8. Inappropriate policies 

9. Transportation problems 

10. Hours when education offered inappropriate 

11. Accreditation problems 

12. Student government problems 

C. Staff Problems 

1. Lack of human relations skill 

2. Lack of academic skill 
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IV. Community Problems 

A. Inadequate community service resources 

B. Community conflict 

C. Lack of community support 

D. Poverty stricken community 

E. Lawless community 



3. Personal problems 



% 



Planning lor Programs 



Planninj for Programs 



Table 4 provides a basic outline for noting c( ntmuruty/school needs and 
matching them to available resources. The most imports. »t fat or, of course, emains 
sound professional judgment in defining and ordering -he various sections of the 
outline. Judgments of frequency, degree of pathology and present ard projected 
efforts are necessary throughout. While the actual use such <x summarizing outline 
rests wit)i the consultation planners, a suggested se ;uence of actions will be pre- 
sented. The format of the outline implies a complete Mirvey, re|>eated periodically. 
While it is recognized that constraints^ often dictate only partial .surveys and esti- 
mates, the principle of basing the definition of needs on survey and study remains 
fundamental. 

Column I requires the listing of those problem or need areas that have been 
defined as imfwtant by consultee and consultant agencies together, through the 
type of review summarized m Tables 1 and 2 and the preceding section. 

Column 11 is to be used for the best estimate of the extent of occurrence of 
each problem area, in numbers of those affected directly and indirectly. In :^ome 
cases, estimates of future incidence may be appropriate, if rapid change is expected 
in the absence of preventive* action. 

Column 11! requires judgment on a HIGH, MKDIUM, or LOW basis, of the 
degree of pathological effect either present or to be expected if no action is taken. 
Difficulty of decision is to be expected (e.g., in judging the severity of effect of two 
years' reading retardation and a high dnig u.sage or venereal di.sease rate) but choices 
among alternatives must be made. 

Column IV requirtn; a rank ordering of all problem areas in terms of overall 
criticality, taking into account incidence and severity but not \et considering 
preventive programs. The difficulty in ordering needs of different type>i is great, but 
the requirement for applying critical judgment in differentiating needs is overriding. 

Column V represents an effort to estimate what actions would Ik» necessary to 
reasonably and effectively cope with each of the rank-ordered problems throughout 
the entire roster. The estimate is m terms of personnel, required resources, and 
estimated time span of the program (long, or short-term). F>rojected cost- 
effectiveness must also be considered. 

Column VI provides a place to candidly note and evaluate present efforts in 
each problem area, in terms of personnel, resources, and length of program. The 
estimated adequacy of the effort should be rated as HIGH, MEDIUM, or LOW. 

Column Vll is for noting realistic restrictions on desired activity. These may be 
low budget or lack of other resources, school administrative caution, CMHC 
philosophy, or other characteristics of the school or CMHC shown in Tables 2 and 3. 
It also allows a final note on the feasibility of potential programs in terms of HIGH 
MEDIUM, or LOW, with all factors considered. 

Column Vlll requires final judgments and ordering of priorities, taking into 
account overall criticality of needs {Column IV), adequacy of present programs 
(Column VI), and feasibility factors (Column VH). It is suggested that the rank 
ordering by priorities at this stage will result in more pointed and critical final 
judgments than will other means of categorization. 
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Planning for Programs 




o s r 
> c O 5i 



o o 

< X 

Ul 



!: £ I 
3 O 5 

1 



la" 



O w 



SI 




14 



Chafer 3 



ASSESSMENT MOPELS ANP 
ASSOeiATEP INSTRUMENTS 

This chapter presiMits proa»durcs for dev(»Ioping objectives for each stage of a 
consultation program and corresponding instruments to monitor consultation and 
assess end results. The chapter includes a general framework of indirect s(»rvice, 
d(»scriptions of the thre(» major approaches that account for the bulk of consulta- 
tion, a discussion of dimensions of assessment, and a generalized model of 
consultation. A detailed example of one type of consultation and summary 
models of all three af)f)roaches are presented, along with appropriate evaluation 
instruments and procedures. The models and instruments are derived from aotual 
consultation practice as s(»en in s(»v(TaI c(»nters: they have not undergone* us(t trial 
and are, then^fore, pres(»nU»d here for the CMHC consultant to usv on a trial basis. 
The models and instruments are based upon specification of consultation goals; 
cl(»ar and sf)ecific goal statements form the essential basis of assessment. 

The difficulties, complexities, and many restrictions attending consultation 
ar(» j^reat; the assessnKMit syst(»m that has be(Mi devt^loped and ihv modvh and 
instruments that are suggested should be used to the (»xtent that they apply to 
the conditions and exig(»nci(»s of a particular situation. Imagination and flt^xibility 
to assun» appropriate* adaptation to local circumstances are acceded u\ the applica- 
tion of the maUTial that follows. 



Framework of Indireet Services 



Th(» n^lationsbip b(»twe(»n a pn»liminary study and th(» various programs of 
consultation that may (Mnerg(» is shown in Figure 1. As stat(»d in the pnuu^ding 
chapter, the purpose* of the preliminary study is to id(MUify th(» most n^levant 
problems, M^t priorities, and examine the various methods that might be utili/.(»d 
in consultative interv(»ntion. Three commonly us(»d mod(»s of consultation are 
pres(»nt(»d in this simpl(» framework: Staff Development - Client-C(Mit(Ted: Staff 
Development - Agency-O^ntered; and Project Developm(»nt. Th(» major goals or 
obj(»ctiv(»s of consultative* int(»rvention an* us(»d to diff(>r(MUiat(» thvsv categ()ri(\s. 

Th(» diagram n^flc^cts the fact that the various categori(»s of indir(>ct s(»rvice do 
not nec(^ssarily occur in pure form. Shifts, from onv approach to another, as 
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Figure 1 



shown by the arrows, emphasize the dynamic nexibility of indirect services. For 
clarity, however, definitions of these modes of intervention are presented as if, in 
practice, they typically existed in pure, unmixed forms 



Deseri^ions of Three A^roaehes 

Client^CenUTed Staff Development. This approach consists larjjely of discus- 
sions between the consultee and the consultant and has as its primary purpose 
development of the capability of school staff members in workinjj with children. 
Client cases are used as a vehicle for trainin^i. While such an approach is primarily 
a consultative effort utilizing classical peer discussion, with the consultant playing 
a Socratic role,' other technique? such as information giving (education) may be 
introduced, as the need arises. (Providing information on child growth and 
development is one example.) 

Agency>Cent(*red Staff Development. This approach may focus upon one or 
both of the following: (a) solving administrative and policy problems that influ- 
ence the mission of the school, and (b) enhancing staff communication and 
understanding, and knowh»dge and acceptance of feelings and attitudes. As with 
client-centered staff d(»vt»lopment, peer discussion charact(»rizes most agency- 
cent(»red staff dev lopment. Information giving and collaborative sharing of 
responsibility, however, do enter wherever they can contribute to the intervention 
proc(»ss. 



*The Socratic rolo i.s scon as a method of aidinjj coasultoos in .solvinj; their own problems by 
a process of discussion and questioninjj aimed at developin>; insi>;ht and new points of view !t is 
anticipated that the consultee w^*' adopt this role in solving his own work problems. The usage of 
this consultinj; method varies aiponj* consultants 



Dimensions of Assessment 



Project Devclopmont. In this approach, attention is centered on the recogni- 
tion and delineation of high-risk groups and the development and implementation 
of projects designed to ameliorate conditions contributing to the potential for 
problems. In (his approach particularly, collaboration and education, as well as 
consultation of the Socratic role-modelmg variety, may all receive equal applica- 
tion. Sharing of responsibility and commitment on the part of the mental health 
center and the school (sometimes in cooperation with other care-giving agencies 
and public groups) is seen as a prerequisite to success. Though often considered to 
be a separate indirect service, formal programs of information and education that 
have been planned, designed, and implemented for school staff, students, or 
associated groups are provided for within this approach. 

It must be reemphasized that the several approaches are frequently pursued 
in combination or sequence. For example, an early period of intervention may be 
focused upon client affairs, shift to peer discussion of agency problems, and shift 
again to development of a project or back to client questions. The framework 
should not be viewed as a rigid system; it allows for a changing focus, more than 
one consultant, and a variety of consultees or consultee groups, as these variations 
are deemed appropriate by joint decisions of the mental health and school 
participants. The simple scheme of Figure 1 serves, then, to identify the modes of 
indirect service treated in this chapter, to emphasize the flow or shift in activity 
which may occur, and to formalize the concept of a preliminary study. 



IKmeii^^ons dt Assessment 



The instruments and procedures described in this chapt<?r are aimed at a 
range of goals and encompass different methods. Generally, they may be classed 
into three related orders, according to: the intended recipient, the type of change 
sought, and the method of assessment employed. 

Primary Recipient. Three levels of recipient are encountered in the typical 
range of consultations: At the system level are schools, school boards, and similar 
operating entities; at the consultee level, teachers, admmistrators, and parents: at 
the client level, students and others who are most commonly affected indirectly 
through consultation with school staff. 

Type of Change. Changes in the system, the consultee, or the client may 
occur in the areas of knowledge or skill, attitude, or observable behavior. At the 
consultee or client level, the typical goal is attitudinal change as manifested in 
behavior. Intermediate objectives may he knov/ledge or skill changes in either 
consultee or client. 

At the system (or institutional) level, the count<»rparts to behavior and 
attitude are function and policy. These may be observed in such system changes 
as the creation of new staffing positions, revised curricula, and increased student 
participation in administration.^ 

Method of Assessment. Regardless of whether the primary recipient is person 
or system, measurement of goal attainment will probably be obtained by one or 
more of three methods. The most desirable method is to obsc»rve actual responses 
to real-life situations, personal or institutional. Because of costs and administrative 
difficulty, such responses are usually difficult to observe.. More easily obtained. 
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A Generalized Model of Consultation 



but requiring careful preparation and ingenuity, are responsea to simulated life 
situations, such as video-taped simulations or administrative exercises. Most 
common, most easily obtained (but often only marginally valid) are responses to 
paper-pencil instruments such as questionnaires, surveys, and scal(\s. 

Also to be considered is the fact Uiat goals need not be only final or 
terminal. Many operations are aimed at mtemediate or (nabling goals. Thus, 
teaching counrelors about setting of student goals has no final goal value per se. 
The gaining jf such knowledge is a legitimate intermediate objective and the 
measuremenv of this new knowledge is a h^gitimate inteii.iediate assessment. The 
distinction between terminal and enabling goals is necessary to avoid the frequent 
practice of treating int(»rmediaU» objectiv(\s i\s if they were final g; als.. 

The final, and very important dimensions of assessment, are time and cost. 
Detailed treatment of these dimensions was bt^yond the scope of this handbook. 
However, provision for recording information on time spent in consultation, by 
the consultant and the consultee, has bc^en included in the assessment instruments. 
For a full assessment, studi(»s of time and costs for consultation, in relation to 
benefit gained, are necessary. Hunter and Rat^liffe (3) provide an example of one 
type of cost study, Macl^ennan. et ai. another (4). A useful reference v/ork on 
this topic has been published My the National Clearinghouse for Mental Health 
Information (5). 



A fieneralized Model of Consultation 

A generalized conceptualization of consultation is presented as Figure 2. This 
model accounts for the consultant, the consultee agency, the goals of consulta- 
tion, the goals of evaluation, and the mt^hods of evaluation. It is a functional, 
time-spanning model with stipes representing the time dimension. Within each 
stage provision is made for statt^mt^nts of the purpose or objective of the stages 
th(» product, the approach used, and suggested evaluation measures. This model 
re(|uires the prior planning and specification of both the overall consultation or 
int<»rvention goals and the objectives of each stage. Such specification is a 
necessary prelude* to the development of all monitoring and evaluation t(»chniques. 
As suggested earlicT. th(» model is int(*nded to be used as a guidc^^flc^xibly and 
adaptably-rather than as a rigid, limiting conceptualization. 



Generalized Model of Consultation 
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An Example of the Proiect Development Model 



An Example of the Project Pevdo^ment Model 

Prior to the presentation of the models for Staff Development — Client- 
Centered, Staff Development — Agency-Centered, and Project Development an 
example of an actual program of consultation will be presented. This example fits 
the Project Development model. The process shown in Figure 2 in three stages has 
been expanded to six. 

Stage I — Planning, Negotiation, and Agreement 

Stage II — Development of Project Plans 

Stage III — Training 

Stage IV — Implementation 

Stages V and VI — Revision, Extension, and Contract Termination 
As in the generalized model of Figure 2, information for each stage is grouped 
according to purpose, product, approach, and suggested evaluation measures. 



$ta§e I • Piannifis^ Ne^ofiatiofi^ and Asreemant 



A. Purpose 

To negotiate the practical arrangements of the contract (such as time,, 
place, frequency of meetings, participants, etc.). 

To review the problem area, define the target population, specify objectives, 
explore and select an approach. 

To obtain commitments, to allot responsibilities; and to schedule successive 
stages of the project. 

B. Product 

Meetings were held with the junior high school principal and counselors to 
discuss their concern about the growing estrangement of a group of Mexican- 
American 7th- and 8th-grade boys and girls. The counselors were not concerned 
with hard-core, longstanding cases, but with those students beginning to show 
one or more of three kinds of patterns: wthdrawal, agressive-disruptive 
behavior, and performance well below poteni'al. 

The general characteristics of the school, determined m the preliminary 
study, were reviewed and throughout the next several sessions were supple- 
mented by additional studies earned out by this consultee group. In analyzing 
the problem special attention was devoted to the follov mg topics. 
1. Composition of Junior High School Population: 

a. What IS the composition of the junior high school in regard fo the 

number of ^ 

1) Anglo, Mexican-American, Negro, and other students^ 

2) Poor and well-to-do families^ 

b Does the composition derived from questK n (a) reflect the population 
composition in the community? 
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c. How does the relative size of the elements of population affect the 
client group^ 

d. What IS the size of the potential chent group relative to the Mexican- 
American school population? 

Ann ^^'1 ' P°P"'^"o" about 650 students, of whom about 

400 are Anglo-American, 200 are Mexican-American, and the remainder 

areTom , H?'""f"°" °--^«'--9 -aion.y of students 

are from steadily employed, working class families, with no obvious dif- 
ference between ethnic groups. The school ratio approximates the com- 
mumty ratio. The problem group represents about half of the total 
Mex.can^Amencan enrollment and seems to have stabilized at this number 
Although complete information is unavailable, there is some evidence that 
an undue proportion of the problem group may come from families who 
more recentl\ have moved from agricultural areas. 

2. Group Attitudes and Interaction: 

a. What are the attitudes and interactions of the ethnic groups? 

1) In the community 

2) In the PTA 

3) In the student body 

4) In the school staff 

b. How do these attitudes affect the potential client group? 

c. What IS the Mexican-American representation m administrative and 
teaching positions' 

d. What are the mental health consultant's attitudes and knowledge regarding 
this cultural group? ^ a y 

Within the community, there is httle participation oi representation 
of the Mexican-American component in civic affairs or in school-board 
activities To a great extent, social activities within the Mex.can-Amencan 
group are confined to essentially in-group activities and places of gathering 
There has been no noticeable move toward cohesive action political or 
otherwise,, to gam representation in community affairs. This same lack of 
activity IS reflected m the school population. There has been no repre.Pnta- 
tion on student council and minimal participation in other than required 
activities, with the exception of a handful participating m band activity 
and after-school sports piogram. 

As noted above, the general pattern in the community and m the 
school IS towaid Mecican m-group cohesiveness, and a tendency toward 
withdrawal and mutual distrust between gioups. There has been little o, 
no evidence of organized disruptive behavior in the school The aggiessive 
behavior of some of the students seems sporadic and spontaneous among 
certain individuals. 

Of the staff of 25, one counselor and two teachers are Mexican- 
Amencan and speak Spanish, are fiom old families in the community and 
are, if anything, old guard m then attitudes toward these pioblem children. 

There ,s viitually no Mexican-American attendance at PTA This is 
not su.pnsing, since most of these parents lack fluency in English About 
a year ago an abortive effo.t was r„ade to engage parents m PTA activities 
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Stage I • Planning, Negotiation, and Agreement 



by sending home announcements, prepared m Spanish, of forthcoming 
meetings. Lack of adequate provision for parents at the meetings led very 
quickly to their continued absence. 

Generally speaking, the teaching staff was little concerned with the 
possible cultural influences on these children~the bilingual problems at 
school and at home, the latent pride, aspirations of children and parents- 
and httle aware of the effects of this lack of recognition upon minority 
children. Through this early consultation phase, the counseling staff and 
principal were beginning to show considerable appreciation'of these 
influences. 

The consultant had previously worked with Mexican-American 
groups in other settings and had acquired some understanding and appre- 
ciation of the problems attending the transplant of one culture into another. 

3. Consideration of Key Factors: 

During these initial sessions, several features emerged as key factors. 
There was general agreement ihat both cultural and adolescent pressures were 
contributing factors The facts of out-group membership, of a real adolescent 
struggle for identity,, of pressure from parents to achieve, of some language 
difficulty, coupled with the fact that all of these pressures were largely being 
met by a staff attitude of msensitivity and low expectation, were seen as 
primary components of the problem. 

The assessment of functional aptitude in the Mexican-American group 
was difficult. Achievement in basic skills was not consistently up to par, yet 
It was felt that average cognitive ability was generally present. While remedial 
work was indicated for certain students, it was felt that priority should go 
toward the changing of basic attitudes and behavioral patterns of the staff 
and this student group. 

4. Selection of Three Projects: 

The analysis of the problem led to identification of three mam areas in 
which to work- the teaching staff, Mexican-American parents of junior high 
school children, and the segment of the Mexican-American student group that 
was exhibiting symptoms of estrangement. It was agreed that this consulting 
group would deal with the student group of problem children. A second 
consultant would be requested from the CMHC to develop a program with 
the teachers The principal and the counselors (in particular the counselor of 
Mexican-American origin) felt that thev could instigate a more positive 
approach to the Mexican-American parent group with consulting available 
from the CMHC on a need basis. 

The consulting group then defined aims and general plans for all three 
areas of attack to provide guidance to the new consultant in the teacher area, 
to the principal-counselor group in the parent area, and to start their own 
project in the student area. An outline of the aims and plans to be considered 
in this three-branched approach follows: 

a. Teacher Area 
1) Aims 

a) Increase their understanding of Mexican-American students and their 
unique problems 
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b) Increase their grasp of the Mexican-American culture and appreciation 
of what this group can offer to the school. 

c) Expand their repertoire of techniques to involve students more in 
class-room activities and other activities related to the school. 

2) Suggested plans 

While the final plans and details would necessarily be worked out 
by the new consultant and some nucleus group of teachers, the following 
suggestions were offered by this consulting group: 

a) Form several small groups of teachers with open discussion of a 
problem-solving nature to explore ways to achieve increased under- 
standing and participation (e.g., establish special skill and/or interest 
groups such as a Spinish club which would be open to all students, 
assignment of classroom projects based on knowledge, skill, or 
materials which have a likelih )od of being unique to the Mexican- 
American student group, etc.). 

b) Hold a workshop focused upon cultural contribution of the Mexican- 
American. 

c) Consider a) and b) above in relation to black and Oriental students 
as well. 

b. Parent Area 

1) Aims 

a) To involve Mexican- American parents in PTA and other school-related 
activities. 

b) To investigate ways the school might contribute to increased English 
language fluency of this Mexican-Ame* ican group of parents. 

c) To develop in them a feeling that they have talents to offer the 
school and reason to {ye interested in what happens in the school. 

2) Suggested plans 

While the final plans and details would be developed by the principal 
and the counselors as an activity separate from this consulting series, 
suggested plans were drawn up to serve as guidance. 

a) Investigate obtaining Spanish-speaking high school students to serve as 
interpreters and, at least initially, as guides to Mexican-American 
parents attending PTA. An alternate approach is to encourage the 
junior high school students to bring their parents and serve as 
interpreters-guides When the most feasible plan has been arranged, 
renew issuing invitations m Spanish. 

b) Explore the possibility of an organized drive-through the school,, 
various news media, and businesses~to enroll Mexican-Americans in 
courses in English for the foreign born. Such a course is available, 
through state funds in the Adult Education program, conducted 
evenings at the high school Prior to beginning such a drive, investi- 
gate the possibility of obtaining volunteers (from the high school, 
the junior high school, and the community at large), to provide 
baby-sitting and transportation where required. 

c) Promote organizing the annual school carnival with a Mexican- 
American theme. Enlist all members of the PTA m this cooperative 
effort. 
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Stage I • Plannmg, Negotiation, and Agreement 



c. Student Area 

1) Aims 

a) To channel disruptive trends into acceptable behavior. 

b) To increase the participation of the withdrawn student. 

c) To improve school performance of those students performing below 
potential. 

2) Plans 

A variety of avenues were explored, ranging from training the staff 
in behevioral modification techniques to systems for tutoring students 
performing below potential, using the disruptive and withdrawn students 
as turors. 

AM consultees felt strongly, however, that these students needed 
an opportunity to develop their own aspirations and goals, defme ways 
to attain their goals, explore the kinds of behavior expected of them, 
enhance their own problem-solving ability, and strengthen the feeling 
that they are responsible for the roles they adopt and the actions 
they take. 

The final decision was to organize several student groups of boys 
or girls with a school counselor and a mental health worker as co-leaders 
of each group. An enabling goal, perhaps of equal importance, was to 
train school personnel in group practice. Longer-range goals were to see 
the school develop self-sufficiency in the training of personnel, and to 
expand this project during subsequent years, if evaluation of this first 
year's outcome were sufficiently promising. Specific responsibilities for 
actions by participants were agreed upon: Gaining administrative 
^ approval for space and time for students,, obtaining support from 

teachers in identification and subsequent evaluation of pupils,; preparing 
plans for selection of participants, etc. A rough schedule was drawn up 
that included the training of co-leaders, date of implementation of the 
project with student groups, and dates for evaluation and termination 
of this intervention. 

C Approach 

Consultation and, to a lesser extent, col'jooration were used by the consul- 
tant as his approaches in this stage. 

D. Suggested Evaluation Measures 

Measures of outcoc^es of this stage are primarily qualitative judgments and 
demonstrable products that are contained . i a log to be maintained by the con- 
sultant. (See Form PD-1, under the section 'The Project Development Model"). 
Particularly important elements of this log for evaluation are: 

1. A written summary of the analysis of the problem 

2. Derivation of objectives for three different approaches. 

3. Agreement oi specific responsibilities and commitments of all participants 

4. A time schedule of planned actions in the student area. 

5. Level of attendance and participation. 
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Stage tl • Development of Project Plans 



Stage II • Pevelopmenf of Project Plans 



A. Purpose 

To plan the formation of groups 

To define the type and aims of group activity. 

To form the selection procedures for students in the groups 

To plan the evaluation of the proiect. 

B. Product 

1. It was decided to limit groups to specific numbers and types of students and 
to match these with control students to enable evaluation of efforts. Plans 
were made for group interaction involving weekly periods of one and 
one half hours. The groups were to be based, approximately, on Bion- 
Tavistock models (see also MacLennan and Felsenfeld.. 6). with general goals 
of improving understanding of role playing and of understanding group 
themes or processes (such as dependency., competition, counter dependency) 
and improvements in handling roles and processes The mam points were that 
focus of discussron is only on the present and future, that responsibility for 
group behavior comes from the group, not from outside., that the leader 
helps only by clarifying and interpreting themes and processes as necessary 
for group development. Specific goals are to enable group members to 
develop their own goals and to understand and handle their own behav.or 
roles. 

2. All-male or all-female groups were to be composed of seven students each 
with three withdrawn students, three under-achievers, and one agressive- 
disrupt.ve student, to be selected and roughly matched with the help of the 
teacher's rating instrument presented as Table 5.' Volunteer co-leaders one 
each from CMHC and school., were named for each of five groups Matched 
control groups were identified. 

3. The .n.t.al ratmgs served as basohne mfornat.on. The same mstruments were 
used for collectKig the final evaluation data. 

C. Approach 

Collaboratrve work among counselors and CMHC personnel 
Suggested Evaluation Measures 

1. Development of specific group plan 

2 Development of form for selection and evaluation of students and 

matched controls 
3. Review of progress, using the Consultant Log. with emphas's on 

d. Continued commitment of time, space.^ attendance, and 
responsibility by school personnel 

b. Adherence to time schedule. 



Re.iat.ngs of part.c.p,H)t5 and rruitched ccurols. one week after the or.q.n.il rat.nq 
demonstrated acceptable lehabihty 
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NOTES ON USE OF 
TEACHER RATING OF STUDENTS 
Project Development Example <Table 5) 



Purpose: 

This form is to be used in st^lection, matching, and follow-up evaluation of experimental 
and control groups of students in a special project. The project mvolves participation, by 
students selected for the experimental treatment, in weekly group discussion with co-leader 
adults who have received some traming in group methods. 



Administration: 

Each teacher is asked to rate certam students in his home room according to Classroom 
Habits, Patterns of Interaction (Obtrusive and Unobtrusive), and Academic Performance. While 
the teacher (or clerk) records the names of all students assigned to the room, only those 
exhibiting at least one characferistic of concern to the teacher are to be rated. The teacher is 
asked to indicate degree of concern on a scale from *'No Concern" to **Great" for each item by 
placing an X in the appropriate box. Two ratings are to be obtained from the teacher, one to be 
used in the selection, matching, and assignment of students to experimental and control groups, 
and one for evaluation purposes at the end of the project. 



Rationale: 

Students who are selected to be participants in peer groups designed to (a) improve their 
understanding of group themes and process; (b) increase* their autonomy in choosing their own 
roles in such interactions: and (c) increase their acceptance of re.sponsibility in selecting their 
own goals, will be expected to show positive change in specific characteristics of concern to their 
teachers. Matched controls, not exposed to such activity, will hi* expected to show less or no 
improvement. By catt»gorizmg teacher concerns, it is possible to judge th(» differential effects on 
thest* problem areas. 



Summary Analysis: 

(1 ) Comparison of teacher's first and second ratings on each student, and teacher's 
evaluation of general improvement. 

(2 ) Comparison of general change bt»tween each ex|H»nmenlal student and his matched 
control. 



Stage III • Training 



Stage III * Training 

A. Purpose 

To carry out a seven-week program, initiated for the training of co-leaders 
by the primary mental health consultant. 

B. Product 

The method used for training was based on the use of practical group 
experience. Trainee members were five school counselors and five CMHC-based 
youth leaders (college-age interns in the CMHC). The consultant, as leader, 
provided the role model. Group meetings, with free discussion, were alternated 
with didactic-interpretive sessions in which tape recordings of the group inter- 
actions were played back and analyzed. Primary emphasis was given tO' The 
distinction between overt and covert themes; certain covert or underlying themes, 
such as competition or dependency; the recognition of defensive or other 
maneuvers; the recognition of roles adopted by group members, and to the 
supportive-interpretive but noninterfering role of the group leader. 

Training continued after the formation of student groups, using tape 
recordings of student meetings as material for discussion and consultation. 

C. Approach 

Educational and training procedures, 

D. Suggested Evaluation Measures 

1 Measures of knowledge acquisition by use of simple,, shoit questions on 

knowledge of group process ' (Measure of skill acquisition appears in Stage IV } 
2. Review of progress, using Consultant Log 



Stage IV - Im^ementation 



A« Purpose 



1, To select experimental and control subjects. 

2 To establish experimental groups and conduct group meetings 



B. Product 



Five student groups and their controls were established, the controls con- 
tinued then normal routine and did not participate in any group Expeiimental 
gioups met on a weekly basis for the remainder of the school year 



A wnitOf) S(M of (UM'stiOfH would h*ivr lo l)e pi»MW<»(l bv the cof^sulttifU to covim the "nmi to 
know" content of the coiirsi* 
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Stage IV • Implementation 



C. Approach 

Continuing consultation and collaboration in guiding progress of groups 
and co-leaders. 

Suggested Evaluation Measures 

1. Final administration of rating of students by teachers. 

2. Comparison of early and late ta^es of group sessions with mental health con- 
sultant and an outside expert rating them on. 

a. Degree of leader awareness of group processes. 

b. Extent to which leader is capable of acting upon this awareness. 

c. Maintenance of noninterfenng role. 

3. Review of progress, using Consultant Log. 



$»a§M V and VI - Revision, Extension, 
and Contfaet Termination 



A, Purpose 
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To study evaluation measures and reach a decision regarding mamtammg and 
revising project or of discontinuing it. 

To terminate or renegotiate the contract. 

Product 

Based upon the evaluation measures obtained, the decision was reached to 
continue the program the following year. The number of groups will remain at 
five but the co-leaders from the CMHC are to be replaced by school personnel. 
The consultant will continue the training series in the following year and will 
continue consulting with the 10 (five new) school co-leaders. 

C. Approach 

A collaborative approach was used in the analysis and interpretation of 
results and in the decisions reached regarding future planning 



Suggested Evaluation Measures 



1. Evidence of reduction m CMHC involvement 

2. Joint terminal review: 

a. Client change data. (Table 5 and school records.) 

b. Consultee data on sktM development as judged by early and late recordings 

of group leading activity, and on acquisition of knowledge of gioup technique 

c. Consultant's revision of some of his training procedures. 

3 Joint review of progress, using Consultant Log, particularly noting, 
a Spinoff to similar program m another school 
b. School's increased interest in other indirect service programs. 



The Models 



The Models 



A .specific example of an indirec t service related to project development has 
iM-en presented in the forcfjoinf; section. The general models for the three types of 
consultation will be prest-nted m detail in th.- following s..ctions. As shown in 
Mfiurc 1 each model is desifjncd in staf{es with purpose, product, approach and 
.suf{f{ested evaluation measures specified within each stage. There are two stages 
common to all three models: The initial stag.- for all of th.-m covers contract 
negotiation (or contract r.^view) to •■stabli.sh agr.vm.^nt and .ommitment on 
oDjec-tives, arrang.-ments for proce.-ding, .sch.-duling, analysis of th.- probl.-m (if 

cons„irw""' rr^r'^T'V" V"'"'""'""''^ •'''"'^y*- ^"'^ ^ f^'^" terminating the 
consul a ion. The final stage for all thnr includes renegotiating or terminating th. 
consultation contra. t, the deci.sion being bas.-d upon an evaluation by all partici- 
pants, or on the effects of con.sultation for the designated client target group 

Ihe u.sefulno.ss of the.se models depend.s upon how well objectives specified 
in Stage I represent the actual purpose of the consultation series and upon the 
U.S.TS accptance of th.- outlin.-d .stages as r.-a.sonabl.. portrayals of what actually 
occurs in each mode of intervention. 

nr .h'^ r-lm?"''^ ''^ ^" f^"^^''^" ^« th.. consultant 

or the CMHC evaluation staff in planning evaluation of an intervention Kach 
stage repres<-nts a point where measurements could be obtained. Many of the 
m.-asures which will be suggested in the .subsequent .s.-ctions are interim or 
progress measures and a number are qualitative rather than quantitative Interim 
or progress measures n-n.-ct th.- outcome of a particular stag.- and are bast-d upon 
the expre.ss puqjose of that stag.-. The final evaluation of an intervention is based 
upon the clear definition of the objectives of th.- infrvntion. which should be 
delineated as a Product under Stage I. 

A clear knowledge of the objectives of the .service is a prerequi.site for any 
deyelopm.Mit of in.stniments or m.-asures; only with a cl.-ar stat.-m.-nt of d.-sin-d 
oukomes is it po.ssible to •■xplon- and .select mea.sur.-s to reflect chang.- attr'ibut- 
di)\v to the intervention. 



THE MODEL FOR SWF PEVELOPMENT - CLIENT-CENTERED 

II JllZ"^"^' '"■'"■"T'^ ^hree stages: I, planning and negotiation; 

t on of the contract. A description of each stage, and the evaluation measures to be 
u.sed are pre.sented in the following pages. 
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The Model for Staff Development ■ Client-Centered 
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The Model for Staff Development - Client-Centered 
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Stage f . Planning 



S'age I • Planning 



Will a\u.nr:vhotnfZdl\t:^^^^^^^^ --^i"^^- who 

of mootings etc- At tZ TZ Tc^ 7 u ^'""'"''^^ ^"^ ^"h^dules 

understood bTall during thU^^^^^^^^^ f'T""' ""'^^ accepU-d'and 

Entries in Part of th! r '""^'t'ngs are to be productive. 

I and conUn e?h^ ^ho the^^r rVh^^'"T "^^-'^ Stage 
and evaluative notes in the form o7\ I ""P"''^^""' "^^^Pi'^K hrief, factual, 
consuming to keen thev ale Zn u "^^'^^tion. While time 

consultation and 'thus 'arran S; .f --^^ of the process of 

provides a contin:.:;' T"^.^ ^^^^ ^^^'"^tive effort. 

later section. Tho mordine of ^-ho^ndm ? u * ™"' '"" ■'«»»'<l >" « 
or now pro.,.™. a„. Part.Lr'y^XSrriull.tS ^"■'"P"'™' 



in Hicrr rcpurl of ,| 
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Form CC-1 



CONSULTANT LOG PART I: ADMINISTRATIVE NOTES 

Staff Development - Client -Centered 



1 School. .. ^ ^ 

^ ' ■ 2 Group . 

3 Partic»rant> 

Name and Specialty (teacher, counselor, nurse, etc ) 

a. 



c. 



4. Opening date 

yuditr. _ _ _ _ Closing date 

5. Presenting problem 



ERLC 



6. Proolem analysis (summary) 



7. Goals . 



8. Plans and strategies 



9. Arrangements 

a. Tm^ 



b Place 



c. Length of series 



d. Special facilities and/or requirements 
e Consultee responsibilities ____ 



t Evaluation plan 



*j tyr%r\ . ^ (Form continued) 

HumRRO - June 1971 
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Porm ceo (Continued) 
10. Speca, nces .-...g.s .n p,an o. a.an^.ents. pa.t.cipan.s. etc.. w..h .a,e of 



note) 



o, ^ .^,„,„,.„„ „ _^ ^^^^ 

Date and Bnef Statement of Change 



(date) 



(date) 



(date) 



(date) 



(date) 



(For 



continued) 



HumRRo June 1971 



Form CC-I (Continued) 

12. Record of new services to be implemerited m this school or some other school as a result of this intervention. 

Date and Brief Statement of New Service and Location 

a. , 

(date) 



b 

(date) 



C. 

(date) 



d 

(date) 



e. 

(date) 



13. Termination or renegotiation notes 



14. Total consuitant time on this consultation series (include travel time, preparation, record keeping, etc.) 



hours. 



HumRRO - June 1971 



Stage 11 • Intervention 



Sfage II - Intervenfion 

This sta^'«» provides for the presentation and discussion of client cas(»s that 
concern the consultees. P'or any individual case, the consultant first listens to the 
presentation and assimilates knowledj^e about the problem. He then turns to an 
exploration of alternative actions, drawing,' as much as possible from the exp(»ri- 
ences and attitudes of all the participants. Alternatives are informally assessed 
according,' to their feasibility and promise. The consultant sums up, restating the 
alternatives that have emerged as highly probable solutions. He may reinforce 
particular courses of action; he tests the presenting consultee's feelings of 
adequacy regarding s(»l(»cted actions, and he gives information if n(»cessary. The 
ultimate decision of whether or not to implement actions remain with the 
consul tee. 

Early in Stage II, two question nain*s an* fill(»d out n»garding consultee and 
consultant expectations. In addition, the Consultant Log. begun in Stage 1, is 
continued and two new sections of the Log are introduced. 

(1) Expectations Questionnaires 

Consultee Expectations ( Form CC-2) and Consultant Expectations 
(Form CC-S) and not(»s on their us(* arc* pre.sent(*d on the following pages. Th(».s(» 
are recommended as interim, or progress. measur(\s of the n(»gotiation stag(». 

Consultant and consultees fill out ({uestionnaires regarding their expecta- 
tions. One item on the Consultant Expectations Questionnaire, asking what \w 
expects the consultees to gain, is identical to that on the consultee's form. A 
comparison of these two s(»ts of r(\sponses should focus upon discn»panci(»s 
between them.' Incongruence represents a potential for conflict and inefficiency. 
With such information available early in the series, the consultant may de cide to 
n»view and alt(»r his roh^ and (expectations or to nMi(»gotiate th(» contract, clarifying 
the cho.sen objectives (by review and amplification of Stage 1 activities). Renegoti- 
ation provides the opportunity for modification of objectives, if that course is 
view(»d as desirable*. 

'I'he consultant normally has two kinds of objectives, the explicit objec- 
tives agreed u\nm m Stage 1 and hM in common with th(» consult(M\s. and implicit 
long-range goals of th(» consultant hims(Mf that may not y(»t hav(» h(»en shar(»d with 
the consult(>es. In addition, there may Ix* more general CMIIC goals, such as the 
development of future programs, which have not yet been ex[)licitly discussed. 
The Consultant ExpecUitions Questionnain^ (Form CC-3) provides a vehicle for 
the concrete formulation of all these goals. 

(2) Co nsultant Log 

Part I of this log has aln^ady hvm discussed. Begun m Stag(» I. it is 
continued and updated throughout the consultation series. 

Part II of th(» log (Form CC-U provides an individual record of each 
consultee\s progress in a consultation S(»ries. It recjuires the consultants judgmcMit 
on each consultee regarding participation, ability to contribute to problem formu- 
lation and alternative actions, and interactive skill with other members of the 
consultation group. Cross m(»asures of negative or positive change can be obtained 
from this record. In addition, the form provides an attendance nu-ord and a 

'Simpl«' analyses ol .ill (juf.stioim.Hn* matrrijls an- \rv,\Wd »n ApptMuhrrs A 1 and A-2 
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means of scheduling follow-up of client cases that have been presented. Again the 
sTuation. improvement, no change, or a wors;ned 

record of^Z t v' S ^^'^^ '^"^'^""'^ maintaining a brief 

exZt Th^f ^"'"^ P''"-"^"^"'^ consultation. To the 
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Form CC-2 

CONSULTEE EXPECTATIONS 

Staff Development - Client Centered 



School 



Name 



Item 



I. What do you think will be the eventual benefits to you of thrs type of consultation^ (Instructions: Check 
the appropriate column for every statement, adding statements as you wish.) 



1. Increased specific knowledge m identifying classes of problems or potential 

problems (high nsk groups) 
7, Increased skill in alleviating classes of problems or potential problems (high 

risk groups) 

3. Increased specific knowledge in identifymg and improving conditions for gifted 
or creative children 

4 Increased general knowledge of "normal" and "abnormal" patterns of behavior. 

5 Increased general knowledge regarding interactions of children at different 
life stages 

6 Direct advice from consultant on presented cases 

7 Assistance from consultant in finding possible solutions for presented cases. 

8 Ideas for school programs that might be of value 

9 Increased confidence m carrying out my daily work 

10 Better understanding of how my f>ehavior affects others m my interactions 
with them 

11 Recommendations hy consultant ;>ased upon his interviews with 
problem children 

12 Assistance in referring children for treatment 

13 Other _ 

14 Other _ . . - 



None or 
Slight 


Considerable 
or Major 

, 




— 








i 

! 


! 
1 

1 



-4 ^ 



MumRRO June 1971 
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USE OF QUESTIONNAIRE ON CONSULTEE EXPECTATIONS (Form CC-2) 
Staff Development - Client-Centered 



Purpose: 

This form provides a record of consultant consultee agreement (or lack of agreement) on 
the objectives negotiaU»d (Compare "Consultee ExpecUtions," Item I, Form CC-2 with 
^•Consultant Expectations." Item I. Form CC-3). (See Example 1 of Appendix A-1 ) 



Administration: 



This form will be administertKl to the consultee by the consultant, and collected by him 
early in the consultation series, after negotiation is completed. 



Rationale: 



The purpose of negotiation is to determine and clarify consultation objectives in order to 
provide a feasible set of expectations generally agreed upon by those concerned. Some 
consultants have gathered daU on expectations, but usually only at the end of consultation, as 
part of a formal evaluation questionnaire. Earlier data on expectations, following negotiation 
sessions should provide more accurate and timely information. 

The consultant also fills out an expectation list similar to the consultc-e's. Major discrep- 
ancies between consulUnt aiid consultee responses following several sessions indicate potential 
for conflict, continutKl misunderstanding, or failure. Awareness of a major discrepancy provides 
opportunity for review, clarification, or renegotiation. 
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Form CC-3 



CONSULTANT EXPECTATIONS 

Staff Development - Cfient-Centered 



School 



Date 



Name 



Item 



L What do you think will be the eventual benefits to the consultees of this type of consultation? 
(fmtructions: Check the appropriate column for every statement, adding statements as you wish.) 



1. IrKreased specific knowledge m identifying classes of problems or potential 
problems (high risk groups). 

2. Increased skill in alleviating classes of problems or potential problems <high 
risk groups). 

3. Increased specific knowledge in identifying and improving conditions for gifted 
or creative children. 

4. Increased general knowledge of "normal" and "abnormal" patterns of behavior. 

5. Increased general knowledge regarding interactions of children at different 
life stages. 

6. Direct advice from consultant on presented cases. 

7. Assistance from consultant in finding possible solutions for presented cases. 

8. Ideas for school programs that might be of value, 

9. Increased confidence m carrying out daily work, 

10. Better understanding of how their behavior affects others m their interactions 
with tt>em. 

11. Recommendations by consultant based upon his interviews with 
problem children. 

12. Assistance m referring children for treatment. 



13, Other: 



14. Other: 



None or 
Slight 


Coostderabie 
or Major 








































i 



















{Form continued) 
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Form CC-3 (Cont/ntmf) 

Ittm 

II. What general or long-range benefits do you expect your Center or the school to achieve from this 
consultation series? (Instructions: Check the appropriate column for every statement. Add state- 
ments as necessary, irKluding long-range implicit goals.) 



1.. To see policies, procedures, and relationships change in a way that will 
promote better mental health in the school. 

2. To progress into broader or more fundamental problems in this school 
or system. 



3. 
4. 
5. 

6. Other 



To promote increased or improved coordination between the school and 
other agencies. 

To gam entry into other schools as a result of building a positive image 
of the mental health worker in this school. 

To improve approaches to mental health problems (new school programs, 
better referral procedures, etc.) 



Non« or 
Slight 



Considarable 
or Major 



7. Other: 



HumRRO - Jun« 1971 



4] 



USE OF QUESTIONNAIRE ON CONSULTANT EXPECTATIONS (Form CC-3) 
Staff Development - Client-Centered 



Purpose: 

This form, used in conjunction with Form CC-2, provides evidence of consultant-consultee 
agreement (or lack of agreement) on expectations and objectives negotiated. (See "Use of 
Questionnaire on Consultee Expectations, Form CC-2.'') 



Administration: 

The consultant will fill out the questionnaire early in the consultation series, following 
negotiations. 

Rationale: 

The suggested comparisons (between consultant and consultee expectations) provide 
guidance that may reduce consultee misconceptions or may lead to changes in objectives. 

The questionnaire also allows the consultant to specify his general goals and objectives as 
well as his implicit objectives and CMHC goals. It is generally acknowledged that the consultant 
shares some objectives with the consultees in the negotiation period of consultation, but has 
certain implicit long-range goals that are not shared. These may be added as **other" by the 
consultant. (An example might be: To make consultees more accepting and less self-recnminative 
regarding problems for which they cannot possibly produce solutions. 
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USE OF CONSULTANT LOG PART ii: CONSULTEE PARTICIPATION (Form CC4) 
Staff Development - Client^^entered 

Purpose: 

This form provides a contmuous rocord for obsorvmg change in the following areas. 

(a) The oonsultee's participation in problem-solving activity 

(b) The consultee's skill in interacting with other participants 

(c) Important attributes of verbal communication 

(d) Client condition at appropnate interval after his case presentation 

Record Keeping: 

Brief entries for each ronsuitee are made on separate forms following each meeting The 
method of record keeping is descnbed on the form. 

Rationale: 

It IS assumed that changes in problem soivmg ability, in communication ability and in 
interpersonal relationships are explicit goals in staff development consultation. Repeated observa- 
tions and notations of specific personal characteristics will L >w cnange (or lack of change) in 
the indmdual consultee over an extended period of time. I iree areas that seem particularly 
important deal with the recognition of key factors and the ability to formulate both problems 
and alternatives, with basic communication skills; and with important personal characteristics 

A simple scoring system allows the cons.iliant to establish a base-line for each person and to 
note apparent change or lack of change. Use ^^is form may be supplemented by occasional 
tape recordings that can be analyzed more objecti ,y. (Appendix C-9). 

Summary Analysis: 

1. Since the presence and direction of change are the requinnJ data, it is suggested that sum 

^^«"^P"^^. the third and fourth consultation ratings and for the last two ratings, 
in ^^^'^'"""t and that the direction of change between these two sums be 

entenuJ in the Change column at the far right, as 0, or - 

2. Final tabulation for any individual will be the negative or positive sum of entries in ^he 
Change column. 

3 The computation of results for Block V is simply a tabulation of improved cases relative 
to the total number of ca- s. thesi- tabulations should be summed for all cc^i^s^ilt??! 
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|£RIC 



School 



CONSULTANT LOG PART ,„ rlrT' 



INSTRUCTIONS. 



Consultee Group 



Classify the outstanding features of th. 



with students and teachers.) 

' Hyperactive 

I Hostile,, rebellious, angry 

3. Nonconforming 

5- ^•""<' 'X'hav.or (obtrusive) 

6. 



^obiemsof the unique behavior of a 
ch..d.^ not related to interaction with 

^ Poor work habits 

B.zarre behav.or (unobtrusn^) 
^- Dependent 
^ Withdrawn 

5. Slow * 

6. 

7. 
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USE OF CONSULTANT LOG PART III: CATEGORY OF 
PRESENTING PROBLEM (Form CC-5) 
Staff Development - Client-Centered 



Purpose: 

This log IS for recording the variety of chent problems discussed during a consultation series. 



Record Keeping: 

The consultant classifies and records the prcM-nted case accordintj to the categories listc»d. 



Rationale: 



In staff development consultation involvinn discussion of cIumiIs. repetition of the same 
types of cases indicates lack of development of sophistication ;.nd uenerali/.ation of knowledge ih 
th«» consultee.s A "imple device to aid the consultant in tracknm the types of cases heinu 
presented over a lonn sc(|uencc of consultation^ is presented in thir* form. 

Two issues are involved The desirability of a wide raime of types of cases, m order to 
insure broad knowh^dne and learninn over a period of time, and asssurum that the ran^e of cases 
includes mon- than those that are particularly disruptive or disturbing to the student.s and staff 
There is oft^'h a tendency to present disruptive types of cases, sometimes resultiim in neglect of 
the less obtrusive, n e . jess disrupt ) but perhaps more troubled child Massinu of one category 
of cases mi«bt well indicate to the consultant the desirability of scmie classroom ol)ser\^ation. 



Summary Analysis* 

A simple cateuori/ation of presc-nted cases, to aid in obtanunu an eciuitable raniie and 
balance 
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Stage ill • Termination 



Stage III - Termination 



Sia^o III of clicMU r(MU(T(»d staff ci(»vclopnicnt consultation occurs accorcim^ 
to th(» f)rcviously ncfiotiatcci plan for tcrnnnation. In this sta^o two major 
activities arc undertaken: (a) final assc^ssmont measures are obtained, and (b) the 
contract is UTminatcd'-t)r it may be renegotiated for a further series alon^ the 
same or new lines. Th(» main evaluation instrument uses a filmed description of a 
behavioral problem. Other measures are final evaluation questionnaires and the 
final appraisal of the Consultant Lo^. 

(1) Pro totype Films 

"Three prototype films, each f)rovidinj,' a sketch of a problem m child 
h(»havior, have been developed. Kach is based on an actual consultation case, but 
with only f)artial information presented. The films may bo used for ass(»ssin« the 
effects of consultation by comparing written responses of school persons who 
have had lengthy consultation with those* who havi* not (controls).' .An alternate 
or additional use of the films is as training material. The three film scripts are 
present(»d m .Appendix A-3. A more complete description of the use of the three 
films is f)r()vided in Form and its associated notes. 

For evaluation, one or more of the sami* films could l>e shown m two 
groups of school f)e()f)le, similar excef)t that one ^roup has had considerable 
clKMit-centered consultatit)n, the other none. The written re.sponses of the two 
^n-oups to ofXMi-ended (luestions (Form CC-i\) may then be compared for breadth 
and (|uality of understanding: of the f)roblems shown, A ^uide for judjiin^ 
responses acc()m[)anies the form. 

Rather than by individual written n'S[)onses, assessment may be made of 
^n-oup performance, Tapi* recording's of m^ip discussion, or recordings made by 
an observer during discussion, may be analyzed and compared between control 

and ccmsultee groups. 

For tramin^. the films could be .shown to con.sultees at difterent 
intervals in the consultation series, the consultees responding to Form and 
then discussing and criticizing their resp()ns(\'; with iho guidance of the consultant. 
(2) C()nsultec and C\msultant Final F valu ation 

In the C\msultee Final Fvaluation ( Form VC-1), admmistered at the end 
of the consultation .serums, each [)articip^nt is presented with th<' same set of 
statements he dealt with earlier in ex[)re,s.sin^ his expectations and is asked to note 
the benefits he has gained. A comparison of his eX[)(H-tations with his judjiment 
about the benefits obtained provides evidence of his ';atisfaction with the .MM'ies. 

..\s a parallel to the consultee*s judgments, the cim.sultant rerates the 
expectations he held for the ^roup m terms of benefits j^ained. 'Fhese ratings are 
obtained on the (\)nsultant Final Fvaluation (Form (X'-S). 

Consultees who completed the series, consultees who discontinued, and 
the c(msultant are all ^ivcMi the opportunity to critically analyze the .series. 
Information from those discontinuing the sitIcs is obtained from Form iV-^). 
These critKjues do not provide data on the outcome or effect of the inteiAcntion 
but are seen as essential in^reduMUs m the total final (^valuation. Tho data 

'a i-on(ri»l uri»up rouid hv nbt.inu-d by UMtiu .1 Mmtl^M unuip t»l m-Iuh)1 pfisonni-l who .iir 
ithout to hi'^in consultation 
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Stage Ml - Termination 



obtained from them should provide suggestions to the consultant for analyzing 
and revising his consultations, 

A measure of the consultant's achievement of his own or his CMHC's 
goals is provided in a comparison of his expectations regarding these objectives 
and his judgment regarding their attainment. Other more global questions such as 
the consultee's recommendations regarding this type of intervention and his 
motivation as a consistent participant are also explored. 
(3) Consultant Log 

A summary of Form CC-4 (Consultant Log Part H) contributes evidence 
of consultee growth in the areas of problem solving and inU»rper.sonal skill. A 
gross measure of chang(» is made by comparing the earlier and later sessions in the 
series. Also, scanning acro.ss all consultees, the consultant may obtain a simple 
count of client presentations and of the frequencies for cases that showed 
improvement, no chang(\ or a negative result. (These analyses are discussed in 
**Use of Consultant Log Part H.") The entries in Parts 1 and HI of the Log 
(Forms CC-1 and CC-5) should be reviewed in this stage. 



S ummary of Model for Staff Development - Client-CenU>red. 

A model for client-centen^d, staff development requiring the specifica- 
tion of objectives, has been present(»d, including suggested measures of the 
achievement of over-all obj(»ctive. The analysis of writUMi responses following a 
filmed prescMitation of a child exhibiting prohh^m b<»havior repre.sents the most 
direct measure of consultation effect. A varu^ty of other measures, derived from 
th(» purpos(»s of succe(»ding stag(>s, are pn^sented as progress measures and sup- 
piemen ts the over-all evaluation. 
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Form CC-6 

CONSULTEE QUESTIONNAIRE ON FILM PRESENTATION 

Staff Developfnent - Client-Centered 



School ' " Date 



Name 



A 1$ there a problem here? If so, what is the mam pfoblem(sl? How do you define the problem($) 



8, In your opinion, what are the factors, in and out of school, that might be contributing to the pfoblem{s)? 
(Go beyond the film in your answer, not all factors could be shown in a short sketch nor are they readily 
available m the first presentation of the case.) 



C. Do you need further information? If so, what kind of information do you want, and from whom 



D. With the information given you, what alternatives would you consider,^ in school and out, for present 
management? 



E. Until you have more information, what actions, if any, would you take immediately 



HumRRO - Juna 1971 
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USE OF PROTOTYPE FILMS (Form CC-6) 

f Purpose: 

These films, depic ting problem situations, are intended for use in evaluating the effects of 
child-centered consultation upon school persons or in serving as training material. 

Rationale: 

1. Evaluation: A long series of child'centered consultations should improve the consult(»e\s 
abilities in three areas: (a) Recognizing and assessing children's prol)lems. (b) Developing 
straU'gies for better handling of prol)lcm cases, and (c) The actual handling of these children. 
Using the films as simulaU'd problem situations allows the consultant to assess consultee change 
in the first two areas. 

Evaluative compari.son could normally l)e accompli.shed in two ways, only one of 
which IS recommended at this time The recommended method requires the presentation of one 
or more films to a group having received consultation and to a similar group not exposed to this 
experience, and the recording of their written or oral responses to the problem situation. A .second 
method (which will occur to the user) involves the use of different film.S on a pn^/post t<«st basis. 
That IS, the con.sultee group responds to a film prol)lem very early in the consultation .series and 
repeats this experience with a similar Init different film much lat<T in the .series This usage requires 
that the films h(. roughly equivalent in prol)lem difficulty. Preliminary .study of these films by two 
groups of mental health profes.sionals l)rought almost unanimous agreement that they vary 
consideral)Iy in difficulty. 

/\nalysis aims at determining the awareness of th(» respondents to each of four major areas: 

(a> The general and specific prof)lems, in terms of effect on the child or on the 
school. 

(b) Possible cau.sative factors of relevance. 

(c) Further information needed, and from whom. 
id) Alt^^-rnative approaches and actions 

The accompanying form handles the.se areas l)y means of open-ended questions to 
which the con.sult<'es respond in writing. 

Evaluation of respon.s<«s lies in the number of generally relevant responses m the four areas. 
Relevance ts defined as adherence to generally accepted cat<'gories of problem d(»finition, 
contributing factors, information gathering, and treatment/action. 

2. Training. Films of this nature have ofti'n b(»en u.sed in teaching a .systematic approach to 
obMTvation. problem definition, information gathering and the handling of problem situations. 
Fr(»(» discussion is int<«rsp(»rs(»d with the systematic development of an orderly approach to the.se 
d(»sired end results. 

Administration: 

The film.s are intended to Ix- shown to small groups of .s< hool personnel, tbo.se who have 
consulted, and those who have not (controlsK for the purpo.se of .stimulating di.scussion of child 
Khavior problems and ni(»asuring diffen^nces in responses wlirch are inferred to be the result of 
the consultation experience. 

hv .r^ u^? ^'^"'""^ " |)resented wliich ,s a sampling of responses prochiccd 

by groups of school p.sychologists and CSUW professionals. It is valid l)v nature of .t,s basis and 
UHfuI as a guide but .should not l)e considen^d exhaustive^ or interpret^.d as normative. Sincv the 
combination of the particular consultant, Uie consultees. and the control respondents introduces 
ZL T'^' A ^^^'^^y^^^^^^ r>erspectivc., and thc^oretical emphasc^s. th. consultant should add, 
from his and respondent .sources, additional responses that hc» considers acceptable and relevant 
three modes of recording are po.s.sil)le: 

id) Written responses to each of the four area h(»adings. 

(b) Cas.setU» or tapemachine recording for later analysis, if comparison of group 
discussion IS the method u.sed. 

(c) Live recording of a group di.scussion by an ob.server. 
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Response Guide to Films of Donald, Susan, Joanna (Form CC-6) 



DONALD 

The Problem 

1 Academic retardation. 

2 Chronically angry or provwative l)ehavior. 
3. Poor peer relationships. 

The Contributing Factors 

1. Mother may bo an important factor in Donald'.s bohavior: she appears to be malicious 
and punishing. 

2. Father possibly a factor-depressing Donald at home. 

3. Behavior is constantly reinforced, in and out of class, by attention of teacher and students. 

4. Pos-tbly early pubertal or psychosexual problems. 

Further Information Needed-From Whom? 

1. More information on role of mother and father in Donald's problem 

2. Baseline behavior data by classroom observation. 

3. Historical information~how long this behavior has existed, etc 

4. Information on cough —allergy -possible illness. 

5. Mother's attitude regarding Donald's precocious development 

6. All information in cumulative folder; IQ. etc* 

7. More information on piHT relationships 

8. More information on whether Donalds <*ymptoms are always in anger or simply provcK-ativ** 

Alternatives and Actions 

1. Behavioral workup and lech nKjues -baseline data. Ix'havioral chei-klist, how frequently dis- 
ruptive. Kstablish r<»inforcement contract between child and parents, between child and 
teacher 

2. **Time-Out" technique- Specific unacceptable l)ehaviors defined; if they occur, child is 
sent to ** Time-Out '* room; reinforcement in b<»ing allow<»d to participat<» again 

3. Possibility of male tutor-up to one hour a day, personal relationship 
4 Refer family for treatment. 

5. Refer boy for supportive therapy (try behavioral technujue first) 

6. Meet with Donald and teacher jointly 

7. Counsc'l teacher- Donald's behavior not |M*r.sonal toward her 

8. Couns<»l parents, enlist them in reinforcement and in changing their attitudes 

9. Utilize tennis or competitive sport. 



SUSAN 

The Problem 

1. Academic retardation. 

2. Possible psychotic «*pisod«v 

3. Possible organic or epileptic syndrome psychomotor ecjuivalent 

The Contributing Factors 

1. Probable organic factor 

2. Chronic reaction of mother to condition. 

3. Possible separation anxiety on part of Susan 

4 Mother possibly reinforcing some of this behavior 
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Response Guide {Form CC-6) (Continued) 
Further Information Needed-From Whom? 

1. Pediatric and neurological study for ^^rganic factors 

2. Complete psychological workup cumulative folder, etc 

3 Behavior at home— whether better, worse, or the same as at school. 

4. Relationship between mother and Susan 

5. Behavioral data in classroom. 

6. Environmental antecedents of attacks 

Alternatives and Actions 

1. Medical and Psychological workups. 

2. Give support to teacher, who is handling her well 

3. Work with mother in supportive counseling— possible agency referral. 

4. Possible EH placement for Susan. 



X)ANNA 

The Problem 

1. Perhaps not a serious problem, typical of many teenagers and not of serious import? 

2. Poor patterns of general interaction with others. 

3. Generally aggressive patterns toward males. 

4. A schoo j problem- i)<)or performance. 

The Contributing Factors 

1. Being reinforced (i.e.. gelling alien lion) by nonproducing 
2 Bad home situation: mother alcoholic, father absent. 

3. Present provocative l)ehavior more acceptable than previous fighting behavior; a step forward 

4. The essential malenevs of the KH class 0 e.. male students and male teacher). Increasing 
provocative behavior ' 

5. Possible haired for father displaced toward other males 

Further Information Needed-From Whom? 

1 Much data on home life, relationship with mother and father 

2 Data on other peer relationships, male and female. 

3 Degree of actual promiscuous lH>havior. {U she only provocative?) 
4. Data from Joanna on her own deeper feelings 

5 Data on Joanna s relationships with other female teachers 

6. Joanna^s behavior patterns in oul of school activity (Is she m other trouble'^ 
7 Reaction of KH teacher to female slu<h'nls in general. 

Alternatives and Actions 

1. Counseling Joanna— m terms of more general objectives determine pres«'nl goals and tr>- to 
show how present methods are not very effective 

2 Combine counseling with Joanna with enlarged role for social studies teucher. counsel 
KH and social studies teacher, providing KH teacher with information on what would 
reward other iy\ws of iM'havior in Joanna. 

3 Refer family to organized CMIK* help. 

4. If sexual problem is mtious. refer Joanna for professional hi*lp 

5. Work with KH and social studies t^sicher together, to reduce continuation of their defensive 
postures. 

6. Reduce school load 

7. Move her out of KH class entirely. 

8. Involve social studies teacher m more of J()anna*s day or week. 

9 Use drama or similar class to meet her needs (i e . M'mi-legitimati/.e them). 
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CONSULTEE FINAL EVALUATION 

Staff Development - Client-Centered 

School^ — 

Date 



Name 



Item 



IVo'LT T'" <'"^-c„ons Check the appropr.a.e column ,or every s.a.emen, 

add.ng statements as vouwsh Statements you added to the Expectat.ons .o,m have be^Illdr) ' 



1 Increased specific knowledge m identifying classes of problems or potential 
problems (high risk groups) 

2 Increased skill in alleviating classes of problems or potential problems (high 
risk groups) ' 

3 Increased specific knowledge m identifying and improving conditions for gif.ed 
or creative children 

4 Increased ge-neial knowledge of "normal" and "abnormal" patterns of behavior 

S. Increased general knowledge regarding infractions of children at diffeient 
lite stages 

6 D.roct advice from consultant on presented cases 

7 Assistance fro.n consultant in f.nding possible solutions for presented cases 

8 Idejs for school programs that rnighi Ix; of value 

9 Ir^credsed confidence m carrying out my daily work 

10 Better understanding of hov. my behavior aff.cis others ,n my .nieractio.s 
with tt^em 

11 Recommendaiior.s by cor.sultant based upor, h,s interviews w-th 
problem children 

12 Assistance m referring children for treatment 

13 Other 

1< Other 



1 None or 
j Slight 


Considerable 
or Major 










i 

1 


i 
1 


! 





I 



^^'"^ Pof m CC-7 (Continued) 

II. What thmgs drd you f»nd about the concnit^^f.^r, . 

uui me consultatmn that were less than satisfactorv? ir^a.x. 
1 Too murh fimo »«'"5Taciory7 (Check appropriate Items). 

E- Other: " 



2 The consultat.on group d>d r,ot always ,r,clude the peoole *hn 

3. _ The .OP. a,..d were .p.a. o, .ea. ^^'^ 

^ The cor,su.,ar„ ,oo o„er, brought up .appropr.a.e a„err,a,.ve ac.ons 

• The cor,sul,ar„ d.d r,o, seem evolved .r, ,he problems d.scussed 

was r,ot easy ,o get alor,g w,th. 

7. "^'^^ was re.uc,ar„,og.ve d.rec, or spec.f.c.r„o,m3,.or, 

T'^*""«^"^""-'^d,o help ar,aly.ear,dclar.fy problems 

Theconsu,tan„a,led,orela,epas,learn.ng,o,a,erd.scuss.onsvy„h„ew.op.cs 
The cor,sul,ar„ fa.led to summar.^e a. the er,d of a sess.or, 

' ' o^rrXt stdt • ^ • de-^e .he. pro^ems 



111. Why d.dyoucor„.r,ue,h,sco„sul,a.,or,. (lr,s.,uc„or,s lr,d.ca,e the 
the appropriate column ) 'noicaie the 



1 I learned enough to make ,t worthwhile 

' '<::ZZT' .h,s ,ype o, 



^ Id.dnot want to disappoint the 
5. Other 



consultant 



IV. In what ways do 



mportance oUach statement by checking 



Sltghtly 


1 

Important ! 


'mpoftani 




1 



vou think consultation has helped you in your interaction with others^ 



V, Overall, do you feel that this has been 



Yes 



a valuable experience' 



No 



HumRRo June 1971 
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USE OF QUESTIONNAIRE ON CONSULTEE FINAL EVALUATION (Form CC-7) 
Staff Development - Client-Centered 



Purpose: 

This form provides mx kinds of information to the consultant for later analysis by him or 
thr (WinC evaluation stiiff. 

(1) Kvidencr of oonsultec's satisfaction, inferred from correspondence between Item I of 
Consultee Final Evaluation and Item I of Consultee Kxpec tations. (Sc»e example 2 in Appendix 

^ ^ Vi) Consultee*s critique of the consultation s<'ries (Item II of Form CC-7). (See example 3 
in Appendix A-l.l 

(3) Information on consultee\s motivation for continued attendance (Item III of Form 
CC-7). (See example \ in Appendix A-1 ) 

(4) Descnptive information on ways ronsultee has improved in his inU-ractions with others 
(Ite'n IV of Form CC-7) 

(5) Consulte(»'s overall opinion of this type of consultation (Item V of Form CC-7). (See 
example 5 in Appendix A-1.) 

(G) Estimate of time spent in consultation and relaU»d activities (Item VI of Form CC-7). 
(Se(» example 6 in .Appendix .A 1.) 

Administration: 

This form is administered and collecU'd by the consultant at the termination of the 
consultation series, for analysis by him or the CMHC evaluation staff. All statements which the 
consultee added to Item I of the Consultee Expectations should be added to Item 1 of the Final 
Evaluation pnor to administration 

Rationale: 

The consult<»e s specific and jjeneral satisfaction with and his critique of the consultation 
si»nes can provide the consultant with valuable information about himrelf and about the group. 
To the exU»nt that a hi^h degree of unanimity is demonstraU»d in checking particular statements 
of Item II, the consultant may wish to (a) spend mor(» time ac(|uainting himself with the 
schooKs), (b) provide more guidance in the formation and membership of a group, (c) carefully 
review and analyze his consulting behavior in this sort of consultation, or (d) guide consultees' 
preparation of client castas by providing them with a suggested format for presentation. 

Item III provides an indication of motivation for continuation. If A, or A and B, are 
checked as important, the sUted motivation is positive, other combination are equivocal or 
negative*. 

Item IV, an open^nded que.stion regarding ways in which consultation improved inU-raction 
with others, makes possible the compilation of resjKjnses of high or recurring frequency, as a 
source of data for future research. 

An overall opinion, to be inlen)reted in conjunction with more specific information, is 
provided in It<'m V. 



Form CC-8 



CONSULTANT FINAL EVALUATION 

Staff Development - Client-Centered 



School 



Date 



Name 



Item 



I. What general benefits do you think your consultees gamed from this consultation? (Instructions: 
Check the appropriate column for ««/y statement, adding statements as you wish. Statements 
you added to the Expectations form should be included on this form.) 



1. Increased specific knowledge fn identifying classes of problems or potential 
problems (high risk groups). 

2. Increased skill m alleviating classes of problems or potential problems (high 
risk groups), 

3. Increased specific knowledge m identifying and improving conditions for gifted 
or creative children. 

4. Increased general knowledge of "normal" and "abnormal" patterns of behavior. 

5. Increased general knowledge regarding interactions of children at different 
life stages. 

6. Direct advice from consultant on presented cases. 



7. Assistance from consultant m finding possible solutions for presented cases 

8. Ideas for school programs that might be of value. 

9. Increased confidence m carrying out daily work 

% 

10. Better understanding of how their behavior affects others in their interactions 
with them. 

11. Recommendations by consultant based upon his interviews wit'i 
problem children. 

12 Assistance m referring children for treatment. 
13. Other: 



14. Other: 



None or 
Slight 


Considerable 
or Major 



























































(Form continued) 
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Item 



Form CC 8 (Contmued) 



S.ate.ents vo. added ,o ,he E.pec,a.,ons <o„n shol LTl'ILt:? " 



' .n:;.st;r:r,;r "--^ °" '^'-^ - ------ P.o.e.s 

' o'^TpT; — '^as .cease, 

this consultation 

6 Other 



f^one Of Consider^ 
S''9ht Of Major ' 



7 Other 



'■ — «z;::",r;,r;' - — o. 

^ Attendance was sporadic 

3 Consutiat.on ser.cs was r^ot long enough 

^ ~ composition was too divcrsi> i*>.fhp, 

Pe-m., access,., a„a,n.en, iVoZllT "' 



5 
6 



J 



Other 



None 



HumR«o June 1971 



60 



USE OF QUESTIONNAIRE ON CONSULTANT FINAL EVALUATION (Form CC 8) 
Staff Development - Client-Centered 



Purpose: 

This form provulos thn»<» kinds of information for th** consultant's analysis or for analysis 
by th(» CMHC evaluation staff: 

(1) Satisfaction that the consultees havo achieved their anticipated benefits. (Compare 
Item I of Form CC-8 with Item of Form CC-3 ) (See example 2 of Appendi A-2.) 

(2) Kvidence that the consultant's CMHC goals have l)een attained (Compare Item II 
of Form CC B with Item U of Form CC 3.) (See example 3 of Appendix A-2.) 

(3) Consultants criti()ue of the copsultation series. (Item III of Forn CCS.) (See 
example 4 of Appt»ndi\ A-2.) 



Administration: 

The con.sultant completes the (jue.stionnaire at the end of the consultation series, for his 
own information or for the CMHC evaluation sUiff All statements the consultant added to Items 
I and II of the Kxp-^-tiitions form < Form CC-3) should he included in his Final Evaluation, 



Rational<" 

An appraisal of the consultee group's atUiinment of objetvtives is provided by the consultant 
m Item I of this (jue.stionnaire The a|)prai.sal of goal attainment includes not only the explicitly 
and mutually a^jreed upon objectives but also the con.sultanfs additional implicit objectives 
rejjardinp the con.su 1 tees 

In addition to the con.sultanfs implicit objectives for his consultees. there are legitimate 
(Vnter Koals that may be e\plu-it (i.e., .shared with the t-onsultee ^roup). or which may remain 
im|)licit An indication of the consultants achievement of these CMHC goals is obtained in Item 
II of this form. 

Item III provides the con.sultant with the opportunity to criti(|ue the consultatioi. <'Tses and 
to explore those factors which he considered n-dufi-d me effectiveness of the .series A formula- 
tion of elements which impaired the consultant's interaction with the group may provide him or 
the evaluation staff with avenues for revisum of future consultation series. The form allows 
accumulation of observations on the ^ame .school by the same or different ccmsultants. [)r()VKling 
basi.s for possible revision of f>rogranis 
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Form CC-9 

SURVEY OF THOSE DISCONTINUING CONSULTATION 

Staff Development - Client-Centered 



School 



Date 



To complete my evaluation of the consultation program of whjch you were originally a member J am asktng 
individuals who discontinued to complete the brief questionnaire below and return it to me Check any of th( 
•ollowing statements that were related to your leaving the group. 

1. My schedule would not allow me to continue 

2. At that time, my work did not involve children with problems 

3 I did not wish to use consultation to gam help with problems 

4. I did not feel it appropriate to discuss problems in a group. 

5 Thi- consultant did not grasp our current educational practices 

6 The consultant was not famihar with our classroom problems. 

7. At that time,^ I did not have children with the kinds of problems being discussed 

8 The group did not include some people who should have been participants 

9. The consultant did not seem involved m the problems discussed. 

10. The consultant was not easy to get along wtth. 

11. Members of the group were usually not prepared for discussion 

^2. I generally did not agree with the chosen course of action 

13. Other — ■ ■ — 
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USE OF THE SURVEY OF THOSE DISCONTINUING CONSULTATION (Form CC-9) 
Staff Development - Client-Centered 



Purpose: 

This form providt^s information from indivuiualh who dis( ontinu(»d consultation prior to th<» 
comp!(»tlon of the s<»ru's. Tho i-onsullant may analy/.c it or it may b(» made available to the 
evaluation staff of the CMHC. (See Appendix A l. example 7.) 

Administration: 

The consultant will ^ive this form to eonsult(H'N who l(»ave the s(»ries. pr(»feral)ly at the time 
they discontinue (if they inform the consultant of this facti or at the close of the series 

Rationale: 

Data from only those who n^main in consultation provide* a »)ias(»d sample of critical 
thought. 

This t|U(»stionnaire has been dev*»loped to provide information in five different areas, 
provided in example 7. Appendix A4. 



The Model for Staff Development • Agency-Centered 



ERIC 



THE MOPEL FOR STAFF DEVELOPMENT > AGENCV-CENTEREP 



The model for agency -centered staff development contains many features in 
common with the client-centered model. Three clear stages in the agency-centered 
model are: 1, planning and negotiation, 11, intervention or consultation, and HI, 
evaluation and termination of the contract. Based upon the negotiation of a 
subcontract, optional stages such as educational workshops or other educational 
or collaborative activity may occur. Options are shown as Stage lib in the model 
presented in Table 7. 



Sta§e I * Plannin) 



As in client-centered consultation, in this stage the mechanics of meeting are 
decided upon, the problem is analyzed, and consultation objectives, planning, and 
evaluation procedures are agreed upon. The most common obj<»ctives of this 
approach are to increase competence in solving policy or administrative problems 
of the school and to improve staff relationships. 

Entries in the Consultant Log Part I (Form AC-1) provide one important 
evaluation measure for this st^e.. They include notation of attendance and 
agreement on problems, plans and objectives. Shortly after completing th;s phase 
the consultees and the consultant fill out questionnaires on their expectations. 
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Stage I ■ Planning 
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Stage I - Planning 
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Form AC1 

CONSULTANT LOG PART i: ADMINISTRATIVE NOTES 

Staff Development - Agency-Centered 



1. School ^ 2. Group 



i. Participants 

Name and Specialty (teacher, counselor, nurse, etc) 



a. 
b. 



4. Open.ng date _ . „ ^ Closing date 

5. Presenting problem „ 



6. Problem analysis (summaryL 



7. Goals__^ 



8 Plans and strategies 



9. Arrangements 

3. Time .._ 

b Place _ 

c. Length of series 



d Special facilities and/or requirements 
e Consuitee responsibilities 



f Evaluation plan^ 



HumRRO - June 1971 rFofin continw^i)' 
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Form AC l (Continued) 
10. Special notes (changes in plan or arrangements, participants, etc., with date of note) 



11. Progress notes (date, problem discussed, general progress): 



tfwm cont»noed> 
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Form AC-1 (Continued) 

12 Record of policy, administrative, or structural change related to this indirect service. 
Date and Brief Statement of Change: 

(date) 



b 

(date) 



C. — 

(date) 



(date) 



(date) 



13 Record of new services to be implemented m this school or some other school as a result of this intervention. 



Date and Brief Statement of New Service and Location 



a 

(date) 



b 

(date) 



C — 
(date) 



ERLC 



d - 

(date) 



e ^ 
(date) 
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Form AC l (Continued) 



14 Termination or renegotiation notes 



15. Total consoltaot t.me on th.s consultation ser.es t-nclude travel t.me, preparation., record keeping, etc ) 



-hours. 
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Stage 11 • Intervention, Poss»ble Modification 



Slaje II - InlertfenlioA, Possible Modifiealion 



The approach used in inU»rv(»ntion is typically pvvr discussion, c(»nU»rinK 
upon administrative and policy issues and on interpersonal problems. Interpersonal 
skills are developed indin»ct!y in this approach, with th«» consultant providing' a 
role model. By the skillful use of questions, suji^'estion. and occasional indirect 
{guidance, the consultant strives continuously to lead tiie consul tees throuj^h a 
search for alUTnatives and toward ev(»ntual consult(u»-chosen solutions to prob- 
lems. The consultant maintains his roU», avoids authoritarian int(»rferenc(», accepts 
consultecs as experts in thtMr own fields, and serves as catalyst in the staff 
development process. Although involved and conc(»rned. the consultant l(»avos 
responsibility for decision and action to the school participants. 

Interim or prof^r^^ss records for this phas(» include ConsulU»e Expectations 
(Form AC-2), Consultant ExpecUitions (Form AC-3), the continuation of entries 
in Part I of the Consultant Lo\i and entries in Part II of the Consultant Log 
(Form AC-4), Part II provides a ready record of each individual's progress in his 
ability to formulate problems, to contribute* alternativ(»s, and to interact with 
other members of the group. These forms closely parallel tho.se of cli<»nt-c(MU(»red 
consultation. Following each form are notes on its use. 



Form AC-2 



CONSULTEE EXPECTATIONS 

Staff Development - Agency-Centered 



School 

Name 



Item 

L What do you think will be the eventual benefits to you of this type of consultation? (Instructions Check 
the appropriate column for every statement, adding statements as you wish ) 

! 

None or j Considerable 
Slight ! or MatOf 

i j 

1. Better understanding of my own actions and behavior as they affect my work ; • 
with others, I 

2. Better understanding and acceptance of the actions and behaviors | j 
of others. ; ! 



3. Increased skill m interacting with others in daily work 



4. Consultant's direct advice on administrative issues, role definitions, personal 
interaction problems, etc. 

5. Consultant's assistance m exploring alternative solutions for administrative 
issues, role definitions, personal interaction problems, etc 

6. Concepts of school programs or policy changes, such as generating greater 
student involvement, promoting greater teacher participation in administra- 
tion, expanding opportunities for creative or disadvantaged children, etc. 

7 Other . ^ 



8. Other: 
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USE OF QUESTIONNAIRE ON CONSULTEE EXPECTATIONS (Form AC-2) 
Staff Development-Ac^ncy-Centered 



Purpose: 



This form provides a record of consultanUonsulU-e agreomcnt (or lack of agreement) on 
the objectives negotiafKl (Compare Consultee ExpecUtions. Item I. Form AC-2 wUh Consultant 
Expectations. Item I. Form AC-3). (See example 1 of Ap,)endix B-1 ) 



Administration: 

sericJSowZ.h"' ^" f by the consultant early in the consultation 

series following the completiun of negotialion. 



Rationale: 



The purpose of nc^tiation ,s to determine and clarify consultation objec tives m order to 
provide a feasible set of expectations generally agreed upon by those concerned. Some clsu It 
ants have gathered data on expec tation., but usually only at the end of consultation, as paxt of a 
forma evaluation questionnaire. Earlier data on expectations, following negotiation sessions 
should provide accurate and timely information. sessions. 

The con.sultant also fill.s out an expectation list, similar to the- consulU-es. Major discrepan- 
•I'nf T! '"'^ "•^^P""''"'' f«"<'w.nR «.veral sessions indicate potential for 

connut. failure, or continuing mi.sunderslandmg. Awarenc-ss of a major discrepancy provides 
opportunity for review, clarification, or renegotiation. irtj ancy provides 



Form AC-3 



CONSULTANT EXPECTATIONS 

Staff Development - Agency -Centered 



School Date 



Name 



It0m 

I. What do you thmk will be the eventual benefits to the consultees of this type of consultation' 
(Instructions: Check the appropriate column for every statement, adding statements as you wish. 
Include implicit long-range goats which you may have.) 



1. Better understanding of their own actions and behaviors m their work 
with others. 

2 Better understanding and acceptance cf the acttons and behavior 
of others 

3. Increased skill in interacting with others m daily work. 

4 Direct advice or; administrative issues, role definitions, personal interaction 
problems, etc 

5. Assistance in exploring alternative solutions for administrative tssues. role 
definitions, personal interaction problems, etc 

6. Concepts of school programs or policy changes, such as genc^'ating greater 
student involvement, promoting greater teacher participation in admmistra 
tion. expanding opportunities for creative or disadvantaged children, etc 

7 Other. 



8 Other 



None Of 
Slight 


— ■ 1 

Considerable ! 
or Major | 




i 




I 


— 

1 
1 

1 




i 

! 

1 — - — - 


— - — ' 

1 




! 
i 
I 


1 




i 




i 
1 
f 
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Form AC-3 (Continued) 



lum 

IL yyhat general or iong range benefits do you expect your Center or the school to achieve from this 
consultation series? (Instructions: Check the appropriate column for every statement. Add statements 
as necessary^ including long-range implicit goals.) 



1. To progress into tKcader or more fundamental problems in this school 
or system. 

2. To develop an atmosphere that is more conducive to ch^ge in 
this school. 



Non« or 
Slight 



Considerable 
or Major 



3. To promote increased or improved coordination with other agencies. 

4. To gain entry into other schools as a result of building a positive 
image of the mental health worker in this school. 

5. Other: 

6. Other: 
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USE OF QUESTIONNAIRE ON CONSULTANT EXPECTATIONS (Form AC-3) 
Staff Development-Agency Centered 



Purpose: 

This form pnwKii's rvKJeru.^ of consultanl ronsultrr ajrrrrmrnt (or lack of -mim^m) on 
rxpccUil.on.s and objcvi.w^ whic h hav.^ bccMi .K.^otialocl (S... Us., of Quest.onnain- on Consulto^ 
Kxpcctations. Fonn A('-2| 



Administration: 

Th(. c-onM.ltanl fills out thr (jui^stionnairc t.arly in Iho (onsullation scrios followinL' iho 
completion of ncjiolialions ^ 



Rationale: 



Tho <omparis<,ns provich. uuuiancc that mav rcduci. consultoc misconceptions or 

may lead to chan>i<»s in objectives 

J*'*: ^■•"••^■^ 111'- '"nM.llunt f, s,„.nS. n,s ^m.-ral «..als and ot.j,.,l,v,-s as 

well as h,s impUc; ohj.-. l.v.vs and CMHC «„als Th.. .•..nsnllanl has .,t,j.., i,v,.s shar.-d with th.- 
consultPPs m tht- n..R«t,at.on p.Tx.d of c.n.sultalu.n.. and usually has in add.l...... .-.TUiin .mph. U 

long.rang- goals that ar.- not shan-d with .onsull.-.-^, Th.'s,. mav add.-d as "..th.-r" hy th.. 
consulUnt. (An example miyht he To mak.- .onsull.-es more accepting and less M-lf-remmmative 
recardinK prohlems for which they cannot possiSly |)rodiKe solutions ) 
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USE OF CONSULTANT LOG PART II: CONSULTEE PARTICIPATION (Form AC-4) 
Staff Development-Agency Centered 



Purpose: 

This form provides a ronlniuous n^cord for ohservin^; vhan^v in the HUlowing areas: 

(a) The consuIte(»'s partit ipation in problem .solving activity 

(b) The consultees skill in inttTattinK with other participants 

(c) Important attributes of verbal communuation 



Record Keeping: 

Brief entries for «»ath t onsultre an* mad«» on separat«» forms following «»ath me«»ting. The 
method of record ke(»ping is described on the form. 

Rationale: 

It IS assumed that changes in proWem solving ability, in communication ability, and in 
interpersonal relationships are explicit goals m staff dev(»lopm(»nt consultation. Rep<»aU»d observa- 
tions and notations of specific personal characteristics will show change (or lack of change) in 
the individual consultee over an ext(»nded period of time. Three areas that seem particularly 
important deal with th(» recognition of key factors and the ability to formulate both problems 
and alternatives: with basic communication skills: and with critical personal characteristics. 

A simple scoring system allows the 'Consultant to establish a base line for each person and to 
note apparent change or lack thereof. Us(» of this form may b«» supplem(»nted by occasional tape 
recordings that can be analyz«»d more objectively. (See Form .XC-S and its alternate.) 



Summary Analysis: 

1. Since the presence and direction of change are th<» reqtjin»d data, it is suggest*»d that sum 
scores be comput<»d for the third and fourth ratings and for the last two ratings, taking (+, -) 
signs into account, and that th(» direction of chang(» b«»tween thes«» two sums be entered in the 
Change column at the far right, as +, 0, or - 

2. Final tabulation for any individual will b«» th(» n(»gativ«» or p<)sitiv«» sum of entries m the 
Change column. 



Stage III - Evaluation and Termination 



Sfage III - Evaluafion and Termination 



In this stage of agency-centered staff development final measures of effective- 
ness are obtained and the contract is terminated or renegotiaU'd. 

(1) Consultee and Consultant Final Evaluation 

The Consultee Final Evaluation (Form AC-5) presents the set of state- 
ments of objectives that the consultee rated in the earlier Expectations Form 
{AC-2). He is now asked to rate these statements for the benefits he feels were 
obtained. A comparison of his expectations with his judgment about benefits 
gained provides evidence of his satisfaction with the stories.. 

The consultant also rerates the expectations he held for the consultee 
group in terms of the benefits he judges were gained, using the Consultant Final 
Evaluation (Form AC-6). 

The consultees who completed the series, the consultees who discon- 
tinued the series (Form AC-7), and the consultant are also asked to analyze the 
series critically in this final evaluation. These critiques provide the consultant with 
data to be used in his analysis md possible revision of consultation in future 
si'ries. 

A measure of the achievement of CMHC implicit and explicit goals is 
provided by comparing the consultant's expectations of his center's objectives 
with his judgment regarding their attainment.. Other more general questions, such 
as the eonsultee's recommendations regarding this type of intervention and his 
motivation as a consistent participant, are also explored. 

(2) Con su ltant Log 

A review of Part I of the Consultant Log (Form A'J-l) provides a place 
for notation of current and final substantive changes in school practice. Structural 
and functional changes within the school, new policies, increased or modified 
staffing, and modification of curricula may (or may not) be direct consequences 
of consultant intervention. The degn»e of contribution of indirect services to such 
effects should be (»stimaU»d, and a brief notation of these changes entered in the 
lo^ They repre.sent positive effects at the level of the school system, in terms of 
mt(»miediaU> or enabling objectives. At the client level, there may be related 
indices of objective or subjective change to be summarized in the log. Quasi- 
objective ob.s(»rvational indices include lessened noise in classrooms, decreased 
mutilation of property, and similar mdieations. More accessible data, though not 
necessarily mor valid, are rates of absenteeism, accidents, and other factors for 
which records are kept. In any case, short notations of systemic or client change 
are crucial elements in the assessment of Agency Centered Staff Development 
interventions. 

A summary of Part II of the log provides data on consultee growth in 
the areas of problem solving and interpersonal skills. A gross measure of change 
can be obtained by comparing the early and the late sessions of the series. 

For thos<» wishing to study tape records of .sessions. Form AC-8 offers 

guidance. 
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Stage fit . Evaluation and Termination 



ea.,„n of 1^^^ A X^TL?""'"^. 

purposes of succeeding stages of consultation f/ measures, derived from 

measures are obtained through judgmen bv Jhe^ '"i'""^ 

benefits gained. Important meSureT o thP ^! the consultant of 

changes in administrative policy Tor wh .eh efir"''"?.'"''' ^ 

projected. ^ ^ ^"^^^ "P"" the student population are 



Form AC-5 

CONSULTEE FINAL EVALUATION 

Staff Development - Agency- Centered 



School 0«e 

Name 

Ittm 

i. What did you obtain from consultation? (Instructions: Check the appropriate column for every statement, 
adding statements as you wish. Statemenu you added to the Expectations form have been mcluddd on 
this form.) 



1. Better understandir^g of my own actions and behavior as they affect mv work 
with others. 

2. Better understandir^g and acceptance of the actions and behavior 
of others. 

3. Increased skill in interacting with others m daily work. 

4. Consultant's direct advice on administrative issues, role definitions, personal 
interaction problems, etc. 



None Of 
Slight 


Consider able 
or Major 



















5. Consultant's assistance m exploring alternative solutions for administrative 
issues, role definitions, personal interaction problems, etc. 

6. Concepts of school programs or pohcy changes, such as generating greater 
student involvement.^ promoting greater teacher participation in admtnistra 
tion. expanding opportunities for creative or disadvantaged children, etc. 

7. Other: 



are things that you found unsatisfactory about the consultation? (Check appropriate statements ) 

We consumed too much time orienting the consultant to our school or school system: 

A The consultant did not readily grasp our current practices m education. 

B. The consultant did not understand the individual roles in our school hierarchy. 

C The consultant was not sufficiently aware of the admi.iistrative restrictions which 

reduce the possibility of effecting change. 

O. _ Other : „ 

2. The consultation group did not always include the people who were necessary to successful outcome. 

3. The group composition was too diverse <in specialty or hierarchical rank) to generate topics of 
common interest. 

(Continued) 
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Form AC 5 (Continued) 
4 The consuilani did not seem involved in the problems discussed. 

5. The consultant was not easy to get along with. 

6. The consultant was reluctant to give direct or specific information. 

7. The consultant failed to help analyze and clarify problems. 

8. The consultant did not prepare himself by reviewing and organizing material from prior sessions. 
9 The consultant failed to summarize at the end of a session 

10. Consultees often did not prepare for the consultation, i e , they could not defifw their problems 
or topics they wished to discuss. 

11. I was rarely satisfied that the solution agreed upon was the be>t of the alternatives discussed. 

12 Other _ „ . . 



Item 



III. Why did you continue this consjitation^ (Instructions* Indicate the importance cf each statement by 
checking the appropriate column.) 



1. I learned enough to makp it worthwhile 

2. I enjoyed the personal stimulation provided by this type of 
discussion. 

3. I had considerable interest in the kind of changes I thought 
this r.'oup might bring about 

4 I continued because I had committed myself and felt 
i should complete the contract 

5 I did not want to disappoint the consultant 



Not 



-r 



' AppMcabte Important 



Slightly 



tmportanf 



6. Other „ 



IV, Overall, do you feel that this has been a valuable experience' 



Yes_ No 

V, Estimate the rtumber of hcjrs you spent preparing for consultation, in consultation sessions, and imple- 
menting actions which resulted from consultation. hours 
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USE OF QUESTIONNAiRE ON CONSULTEE FINAL tVALUATION (Form AC-5) 
Staff Development-Agency Centered 



Purpose: 

riiiN form proviili'N Uvr kimh of information to th»- roiisultant ft)r laliT analysis l)y him or 
Ww CMHC evaluation staff. 

1. Evidfniv of consultees satisfaction, inffrrctl by comparinii Item I of Consultfo Final 
Kvaluation and lti«m I of Consult*'*' Kxpi'i tations. Form A('-2. (Sim* exampic 2 in Appendix B-lj 

2 ( onsultee's mtii|u«' of the ronsultatior. series (Item 11 of Consultee Final Kvaluationi. 
iSer Fxample 3 of Appendix H I. I 

h)f'irmation regard mu motivation for continued alti'ndanee (Item III of Final Kvalua- 
ti MU. (See Kxanipit* I of .Appendix H I. I 

•I ( onsultee s overall opinion u^nnrdm^ the value c;f this typ«' of coiisultatit)!! (Results of 
Item IV of (*onsuItee Final F.valuation). (See FAample 5 of \p|M'ndix BlJ 

5. Kstmiate of time spi'ut in eonsultation and related activitu's (Item V Fmal Kvalua- 
tioni. (Se«* Example 6 of Appendix B l.i 



Administration: 

Thw fortn i^ administered !)y the eoiisultant at the t«'rnnnation of th«» consultation s<'nes for 
analysis l)y the consultant aiulor the ( MHC evaluation staff. .MI slat«'m«'nts which the consultec* 
add«Hi to !t«'ni I of the ('onsulte«' Expectations form should hv add«'d ♦o It«'m ! of the Final 
Evaluation form prior to administration. 



Rationale: 



5- 
\ 



Ihe consulte«*'s sp«'cific and ^:«'neral satisfacl.on with the consultation M'rws an<l his criti(|u«» 
of the MTies can provid«' the consultant with valuable information about himself and. to an 
ext«'ni. about the ^roup To the d«»j:ree that a particular uroup. or clifferent uroups, demonstrate 
a hiul) d«*jiree of unanimity in ch«'ckinu particular statements of Item I!, the consultant may wish 
to Hi spend more time ac(]uaintinu himself with th«» school(s). (2l provtde mon* uuidanci* in th«' 
formation and membership of a uroup. carefully r«*view and analy/.«' his consultinu behavior 
in this sort of consultation, or ( U uuid«' consuIt«*«*s in th«*ir preparation for meetinjis if 
administrative problems are to be pn'sented 

Ihe couhultee's stated motivations for co *mued attendance are explored in !t<'ni III. 
Selertion of statements \ and or (V or th«'ir co. !)iiiation with H. may be considered evidenc*' 
for positiv** motivation. .Any other combinations are ec|uivcM*aI or negative. 

.An overall opinion, to br inter|>reted m conjunction with more specific information, is 
provided in Item l\* 



o 
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Form AC-6 

CONSULTANT FINAL EVALUATION 

Staff Development - Agency -Centered 



School 



Date 



Name 



L Wfiat general benefits do you think youf consultees gained from this consultation? (Instructions: Check 
the appropriate column for every statement, adding statements as you wish. Statements you added to 
the Expectations form should be included on this form ) 



1. Better understanding of their o\Affi actions and behav;ors in their work 
with others. 

2. Better understanding and acceptance of the actions and behavior 
of others 

3. Increased skill m interacting with others in daily work. 

4. Direct advice on administrative issues, rote definitions, persoiial 
interaction problems, etc 

5. Assistance in exploring alternative solutions for administrative 
issues, role definitions, personal interaction problems, etc 

6. Concepts of school programs or policy changes, s»'ch as generating greater 
student involvenient. promoting greatet teacher participation in admtnistra 
tion. expanding opportunities for creative or disadvantaged children, etc 

1. Other: 



None Of 
Slight 


Considerable 
Of Ma|Of 














— 









IL What general or Jpng range benefits did you center or tt^e school achieve from this consultation scnes^ 
(Instructions Check the appropriate column for every statement Statements you added to the Expecta- 
tions form should be included on this form ) 



1. PI VIS have been made to work on broader or more fundamental problems 
in this school or system. 

2 The atmosphere has t>ecome more conducive to change *n this school, 

3. Coordination with other agencies has increased or improved 

4. Entry has been gained into other schools as a result of this consultation 

5. Other . . . - _ 

6. Other „ _ = . ^ - - — 



None o* 
Slight 


Cons tdef able 
Of Ma|Of 








! 

i 


1 


i 

i 

i 




' 1 

! 

1 ^ 




\ 
; 
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Form AC-6 (Continued! 

Item 

III. What factors reduced the effectiveness of th.s consultat.on> (Check as appropriate.) 

1..^ Consultees did not want the consultation, but were present because of administrative pressure 

2. Attendance was sporadic 

3 Consultation series was not long enough, 

"^' — l^^ ^'^'^ate of the school system prevented these consultees from developing free and 
honest communication. 

5._The group^com^^^ was too diverse, (either m specialty or hierarchical rank) to permit 
successful attainment of objectives. 



Other: 



7. Other 



8. None. 
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USE OF QUESTIONNAIRE ON CONSULTANT FINAL EVALUATION (Form AC-6) 
Staff Development-Agency Centered 



Purpose: 

This form provides three kinds of information for th(» consultant's analysis or for analysis 
by tht» CMHC t»valuation staff. 

1. Satisfaction that the consultees have achieved the anticipated benefits (Compare 
Item i of Form AC-6 with lU»m I of Form AC-3.) (See example 2 in Appendix B-2.) 

2. Kvidence that the consultant's CMHC j;oals have been attained (compare Item II of 
Form AC:-6 with Item II of Form AC-3). (See example 3 in Appendix B-2.) 

3 Consultants critique of the consultation series (Item III of Form AC-S). (See 
example 4 in Appendix B-2.) 

Adndinistratiofi: 

The consultant completes the questionnaire at the end of the consultation series for his own 
information or for the CMIK' evaluation staff. All statements the consultant addf»d to Items II 
and 111 of the Kxpectations fonii (Form AC-3) should be included in his Final l':valuation. 



Rationale: 

An appraisal of the consultee ^roup s atUnnm*»nt of objectiv«»s is provuh^d by the consultant 
m this questionnaire, the appraisal of \ioi\\ attainment includes not only the explicitly and 
mutually a^jreed upon objectives but also the consultant's additional implicit objectives regarding: 
the consultees. 

In addition to the implicit objectives which the consultant has for his consultees. there are 
CenUT v^oiih that may be explu-it (le., shared with the consultee ^roup). *)r that may remain 
implicit. An indication of the consultant's achievement of these CMHC ^oals is obtained m Item 
II. 

Item III provKle> the consultant with the opportunity to critique th*» consultation series and 
to explore those factors which he considen»d reduc(»d the eff*»ctiven*»ss of the serus. A formula- 
tion of elements which impaired the consultant s mteractum with the uroup may provide him, or 
the evaluation staff, with avenues for revision of future consultation s*'ru»s. The form allows 
accniulation of observations on the same school by th*» same or different consultants, providing 
basis for pt)ssil>le n»vision of ov(»rall consultation approach or of consultation pro^iram^. 



Form AC-7 

SURVEY OF THOSE DISCONUAIUING CONSULTATION 

Staff Development - Agency Centered 

School Qalg 

To complete my evaluation of the consultation program of which you were originally a member, I am asking 
individuals who discontinued to complete the brief questionnaire bdow and return it lo me Check any of the 
following statements that were related to your leaving the group. 

1. My schedule would not allow me to continue. 

2. I did not wish to use consultation to gam help with problems. 

... 3, I d«d not feel it appropriate to discuss problems in a group. 

4. The consultant dtd not grasp our current educational practices. 

5. The consultant did not understand our administrative and interpersonal problems. 

6. The group did not include some people who should have been participants 

7. The consultant did not seem involved in the problems discussed. 

8. The consultant was not easy to get along with. 

9. Members of the group wefe usually not prepared for discussion. 

• generally did not agree with the chosen course of action 

11. The consultant's suggestions were often not appropriate to our school. 

12. Other: _ 
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USE OF THE SURVEY OF THOSE DISCONTINUING CONSULTATION (Form AC-7) 

Staff Development-Agency Centered 



Purpose: 

This form provides information from individuals who diS(ontinu(»d consultation prior the 
complotion of th(» series. The consultant may analyze* it or it may be made available to the 
evaluation staff of the CMHC 

Admimstratfon: 

The consultant gives this form to consultees who leave the stones, pref -rably at the time 
they discontinue, or at the close* of the series. 

Rationale: 

Data from only those who remaint^d m consultation provide a bias<'d sample of critical 
thought. 

This questionnaire has been d(»veloped to provide information in five different areas, 
provided in example 7 in Appendix B l. 
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USE OF FORM FOR ANALYSIS OF TAPE RECORD FOR 
STAFF DEVELOPMFNT CONSULTATION (Form AC--8) 



Purpose: 

This form provides a method for analyzing and comparmg recordingj; of eonsultation 
sessions. 

Administration: 

Good quality cassette or tape-machine records are relatively easily obtained for conferences. 
WiUi some practice, the consultant or staff evaluation person can analyze content and consultee 
characteristics, using this analysis form. 

Rationale: 

If tape records of early consultations are compared with tape records after considerable 
consultation, the comparative incidence of active, positive participation by the consultees may be 
estimated. This form is a two-dimensional measure of consultee characteristics in consultation 
interaction By replaying taped consultations, notations may be made of each consultant's 
activity in terms of (a| whether his contributions were elicited or volunt4»ered, and (b) whether 
his contributions were positive, negative, or neutral in tone. Between tape samples 1 and 2, there 
should be a shift toward positive, volunteered comments. 

It is recommended that whole sessions be analyzed. Other research (8) (9) indicates that the 
character of group interaction can change considerably even within a single session. This means 
that, if five- or ten-minute samples are used, they should repre.sent each part of the session 
equally. More importantly, if the consulUtion includes case pre.sentations, the sample(s) for 
analysis must be repre.sentative of the presentation and discussion of each case. 

Instructions for Use: 

(1) The consultant or staff evaluation person enters the code (initials or number) for each 
contributor in the appropriate space, for each statement made. Summing of the.se entries on the 
group in each category and then determining the proportion of the total in each category for 
each sample will provide a picture of comparative shift in categories between early and late 
sessions. In the case of a typical, small-sized group, all participants may be recorded on the same 
page. Additional forms should be used as required. 

(2) For observing group (not individual) change, only one code mark, such as X, can 
represent all consultees 
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U£F OF FORM FOR ANALYSIS OF TAPE RECORDS FOR 
STAFF DEVELOPMENT CONSULTATION 
(Alternate Form AC -8) 



Description: 

Reference is made lo the instructions and use for the Form AC S. This alteniaU* form is a 
three-dimensional measure of consultee characleristi'js in the consulting situation. By replaying 
taped consultations, notations may be made of each consultant's contribution in terms of 
(a) positive, neutral, or negative statements; (b) volunteered or elecited contributions; and 
(c) whether the contribution was in the area of problem definition or problem solution. This 
form is for research purposes, and provides greaU»r capability for analyzing in detail the shifts for 
particular content categories. 



Instructions for Use: 

(1) The consultant or staff evaluation person enters llie code Omtials or number I for each 
contributor in the appropriate space, for each slalemenl made Summing of these eiitru^ on the 
group in each categor>' and then determining the proportion of llie total m each category for 
each sample will provid** a piUure of comparative sliifl in lalegoriCN helwtvn earl> and late 
sessions. In the case of a typical, small si/ed group, all parlu ipaiits may Ih» recorded on the same 
l>age. Additional forms should be used as retiiiired. 

(2) For this alU»rnate form, an additional dinuMiMon of conleiil of >lalenient l^ provided 

(3) For observing group <nol individual) change, only one code mark, such as X. can 
n»presiMit all consul tees. 
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The Model for Project Development 



THE MODEL FOR PROJECT DEVELOPMENT 



The Project Development model is more abstract and generalized than either 
of the other models presented. Objectives for assessment of indirect services for 
the development of a project in a school system must necessarily be specific to a 
particular project. In the model, therefore, no objectives can be specified. 
(Application of the model was demonstrated earlier by way of example). 

Table 8 presents the stages that may be anticipated in a comprehensive 
project. Not all stages are necessarily required for any particular project. Products 
of particular stages are stated generally; it is not expected that all would be 
applicable in every instance. With the exception of the Consultant Log (Form 
PD-1) the suggested measures of effect are simply samples of possible measures to 
be considered; many additional candidate measures may be pertinent. 

Tlie log provides for admi. strative records on all contract arrangements; a 
summary of the problem; definition of goals, plans, and strategies; progress notes 
on each meeting; policy changes in the school; and spin-off into new programs of 
indirect service. Entries in the log are begun in Stage I and continue throughout 
the consultation senes. 

The example of the Project Development Model, presented eariier in the 
text, demonstrates the heuristic value of this model in the construction of 
assessment instruments; the value of this model rests on its use as a guide rather 
than a prescription. Redefinition and modification should occur in conjunction 
with planning and specifying objectives for a particular project under 
consideration. 
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The Model for Pro)ect Development 
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The Model for Pioject Developmen: 
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Form PO l 

CONSULTANT LOG: ADMINISTRATIVE NOTES 



1 School _^ , 2. Group 

3. Participants 

Name and Specialty (teacher, counselor, nurse, etc.) 



a. 
b. 



4. Opening date Closing date 

5. Presenting problem ,. 



6. Problem analysis (summary) 



7. Goals ^_ 



8. Plan and strategies 



9. Arrangements 

a. Time_ „ . 

b. Place _^ , 

c. Length of series _ „ „ 

d. Special facilities and/or requirements. 

e. Consultee responsibilities „ . 



Evaluation plan 
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Form PD-1 (Continued) 
10. Special notes (changes in plan or arrangements, participants, etc., with date of note). 



11. Progress notes (date, topics of discussion, general progress, decisions reached). 



i u ««« . (Form continued) 

E HumRRO - June 1971 

I 

£ 

I 97 



ERIC 



Form PD-1 (Continued) 

12. Record of policy, administrative, or structural change related to this indirect service. 
Date and Brief Statement of Change: 



(date) 



b. 



<date) 



<date) 



d. 

<date) 



<date) 



I 



13. Record of new services to be implemented in this school or some other school as a result of this intervention. 

Date and Brief Statement of New Service and Location: 

a. . -—- — -™ 

<date) 



i 



Idate) 



<date) 



(date) 



<Fofm continued) 
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14. Termination or renegotiation notes 



K Total consultant time on this consultation series (include travel, preparation, record keeping, etc.) 
hours. 

K Total consultee time on this consultation series (include preparation time and implementation.) 
hours. 
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Chapter Summary 

In this chapter, asstissmcnt instruments are pn^sented for three modes of 
indirect service: Staff Development - Client-Centered, Staff Development -- 
Agency-Centi'red. and Project Development. As a preliminary step, models of each 
approach to mental health inU'rvention were develoix-d. Each model r(;li(!s upon 
specification of the end-goal (or goals) of mtervention and the objectives ot 
particular stages within the intervention as sources of measurement techniques. A 
number of instruments-prototyix.' films, questionnaires, logs, and a variety of 

progress records— are included. , • r 

A number of experienced mental health workers in the field of indirect 
services to schools have reviewed the models presenU'd hen- They found a good 
fit between examples of th(!ir consultativi- intervention and one of the models 
described in this handbook. 

The models have value in the high degree of generality of their applicability 
to instances of the three types of indirect servi(;e. Each model provides an 
approach to measurement that can be adapted to the specialized circumstances 
found in a particular location. Many of the instruments described in this hand- 
book will be found to be usable with little or no adaptation in the .settings of 
particular community mentid health centers: others will be found to require 
appreciable modification to the circumstances of a particular setting. 
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Appendix A-1 

SUGGESTED ANALYSES OF CONSULTEE FORMS 

Staff Development - Client-Centered 



To be used by the consultant or the CMHC evaluation staff 



Consultee 
Y 



TOTAL 



1. Consultant-consultee agreement, using Item I of 
Consultee Expectations (Form CC-2) and Item I of 
Consultant Expectations (Form CC-3). Include added 
statements in this analysis. Special attention should 
be given to the outcome of statements 6, 1 1., 
and added others to note whether the consultee 
still has misconception about the purpose of 
consultation. 

A. PLUS (Agreement) 

(1) Number of statements marked expected by 
both consultant and consultee. 

(2) Number of statements marked not expected 
by both consultant and consultee. 



AGREEMENT: 



8. MINUS 



(1) Number of statements marked expected by 
consultant, not expected by consultee. 

(2) Number of statements marked hot expected 
by consultant, expected by consultee 



DISCREPANCY: 

Note: The overall picture and the area and number of di;.crepancies may be more significant than the 
arithmetic balance. As cases build up, numbers can be convened to percentages. 

2. Comparison of Consultee Expectation and Final 
Evaluation, using Item I of Consultee Expectations 
(Form CC-2) and Item I of Consultee Final 
Evaluation (Form CC-7) (excluding statements 6, 11. 
and other added statements which the consultant 
feels are clear misconceptions on the part of 
the consultee. Also exclude those instances where 
none or slight is checked on both forms). 
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A. PLUS 



(1) Number of statements checked at same or 
higher level on final evaluation tnan on 
expectation. 

6. MINUS 

(1) Number of statements checked at lower 
level on final evaluation than on 
expectations. 

3. Consultees' critique of the consultation series, using 
Item II of Consultee Final Evaluation (Form CC-7). 

A. Number of statements checked by each 
consultee in each category: 

Statement Content 

A1, A2, A3 Consultant's acquaintance with 
school 

B Composition of group 

D, E, F, G. Consultant characteristics 
H.I 

J Consultee preparation 

C, K Consultee characteristics 

TOTAL: 

4. Consultees' motivation for continuing, using 

Item III of Consultee Final Evaluation (Form CC-7). 

Enter number of statements checked as important 
i n any degree. 

A. Learned 

8. Stimulated 

C. Committed 

D. Please consultant 

I 5. Consultees' overall opinion of consultation, using 

I ^tem V of Consultee Final Evaluation. (Tabulate 

P "Yes" answers.) 

^» 

& 6- Number of hours spent in consultation and related 

f activities. (Item VI, Form CC-7.) (Tabulate number 

^ of fiours.) 

m- 

S Critique of consultation by those discontinuing, 

0-' using S urvey of Those Discontinuing Consultation. 

W (Form CC-9) 



A. Number of statements checked in each 
category by consultee droupout. 

Statement Content 

1 Beyond control 

2,3,4,7, 12 Consultee characteristics 

5, 6 Consultant's acquaintance with 

school 

9, 10 Consultant characteristics 

8,11 Group characteristics 



Consultee: 

X Y Z TOTAL 



TOTAL: 
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SUGGESTED ANALYSES OF CONSULTANT FORMS 

Staff Development - Client*Centered 

Consultant'consultee agreement following negotiation. 
(Example 1. Appendix A-1) y "^^^"N 

Consultee goal achievement as judged by consultant, using Item 1 
of Consultant Expectation (Form AC-3) and Item I of Consultant 
Final Evaluation (Form AC'6). 

A. PLUS 

Number of stateme »s checked at same or higher level on Final 
Evaluation. 

B MINUS 

Njmber of statements checked at higher level on Expectation. 

Consultant satisfaction that CMHC goals are attained, using Item II of 
Consultant Expectat.ons (Form AC-3) ^id Item II of Consultant Final 
Evaluation (Form AC-6). 

A. PLUS 

Number of statements checked at same or higher level on Final 
Evaluation. 

B. MINUS 

Number of statements checked at higher level on Expectation. 

C. Unplanned benefits, i.e.. number of additional benefits introduced 
on the Consultant Final Evaluation form. 

Critique of consultation by consultant 

A simple tally of Item III, Consultant Final Evaluation, (Form AC-6} 
ts all that IS required. 



Appendix A-3 
FILM SCRIPTS 

A. DONALD 



EXTERIOR SHOT OF SCHOOL GROUNDS, 
KIDS COMING TO SCHOOL IN .^M, 
ZOOM IN TO F.^NCY CAR STOPPING IN 
FRONT OF SCHOOL. 

BOY GETS OUT OF CAR. CUT TO MS 
OF BOY GETTING OUT OF CAR. 
NICELY DRESSED MOTHER HANDS HIM 
HIS BOOKS. BOY STARTS TO LEAVE. 

CUT TO CU OF MOTHER CALLING HIM 
BACK TO CAR. 

CUT TO CLOSE- UP OF BOY REACT iNG 
NEGATIVELY TO CALL BACK... BUT GOES. 

CU OF MOTHER TALKING ANIMATEDLY. 

CUT TO MS OF BOY TURNING AND WALKING 
INTO CAMERA. 

DISS. TO DONALD WALKING DOW^ HALL 
TO CLASS SWINGING BOOKS. MS. PASSES 
ANOTHER KID'S BOOKS STACKED BY 
WALL, LUNCH BAG ON TOP. DONALD GOES 
OVER i>\ND KICKS LUNCH BAG WITH FOOT, 
LAUGHS .AND GOES ON. CU 

DISS. TO DONALD WRESTLING WITH MUCH 
SMALLER BOY. DONALD HOLDS BOY DOWN 
UNTIL SMALLER BOY STARTS CRYING. 



DONALD GETS UP AND SMXLLER BOY RUNS. 

DONALD YELLS AT HIM, VERY UGLY. 

DONALD, SriTlNG ON GRASS, WATCHES 
BOY LEAVE, HALF SMILE ON DONALD'S 
FACE . 



This is Donald... age 12, and he 
has problems . 



Tliis is one of then. 



A nice, anxious middle- class mother. 



From time to time during most sciiool 
days, Donald's acting-out beiiavior 
took on a decided antisocial pattern. 



He didn't confine his antagonism to 
inanimate objects either. . .quite often 
lie included his fellow students... 
wlien they were smaller. 



He didn't have many friends, need- 
less to say... lie seemed quite proud 
III being socially obnoxious. 



m 

Si 



ERIC 



m 



CUT TO INT. VIEW, TEACHERS POV. 
DONALD STANDS IN DOORWAY FOR A 
MOMENT. TEACHER LOOKS UP. DONALD 
PUTS HIS BOOKS ON THE FLOOR AND 
SLIDES THEM TOWARD HIS DESK. 



There was r/jver rny doubt when Donald 
arrived on the scene. His classmates 
always enjoyed his performances much 
more than the teacher did. 



OTHER STUDENTS REACT ... DONALD LOOKS 
AT TEACHER DEFLXNTLY AND GOES TO 
HIS DESK, WHISTLING LOUDLY. 

TEACHER TALKING TO PUPIL AT HER 
DESK. 



He is a sixth grader doing about 
fourth-grade work in reading and 
arithmetic skills. 

Donald was always ready for combat. 
The EH teacher found it very diffi- 
cult to handle his incessant 
demands for attention. 



TEACHER AT DONALD'S DESK, 
ENCOURAGING 

DONALD SITTING IN MIDDLE OF ROOM, 
TEACHER STANDING OVER HIM, POINT- 
ING BACK TO HIS DESK .^ND YELLING. 

DONALD WORKING AT DESK, TEACHER 
PASSES BY, LOOKS DOWN, SMILES, 
DONALD LOOKS UP AT HER BUT DOESN'T 
REACT . 

DONALD CRUMPLES UP PIECE OF PAPER 
AND THROWS IT AT STUDENT NEAREST 
HIM. 



TENNIS COURT SCENE 



She tried personal help ... encourage- 
ment.. even severe scolding. 



DOOR OPENS AND TEACHER HIiRDS 
DONALD INTO ROOM. SHE EXPLAINS 
THAT THIS IS DONALD .\NI) LEAVES 
OFFICE IN DESPERATE MOOD. AS 
TEACHER LEAVES, DONALD TURNS 
TOWARD HER BACK, MAKES UGLY PACE 
AND GIVES HER THE FINGER. FREEZE., 
DONALD IN FG MCU. . .PSYCHOLOGlS'f 
IN BG, CANNOT ACTUALLY SliE 
DONALD^S I'ACE OR GESTURE. HOLD 
FREEZE FR;\ME TO BLACK. 



After an outburst from the teacher, 
Donald would momentarily be con- 
tented and would actually be able 
to work happily for a while. 

But this never lasted very long. 
Invariably, he would become con- 
fused, lose his concentration, and 
his acting-out cycle would begin 
all over again. 

The first time I remember seeing 
Donald was one morning on the school 
tennis court. I remember asking him 
to come play with us. He was a sad 
looking child. He seemed to want 
to be a part of things but just 
didn't quite know how. I couldn't 
tell whether he was really not 
interested or just shy. 

And then one day Donald appeared in 
my office. His EH teacher brought 
him in and they were both at their 
wit's end. I was already familiar 
with some aspects of the problem of 
Donald from the reports his teacher 
had given me, but I wasn't quite 
prepared i'or Donald* s obvious feel- 
ings toward her and now the problem 
was mine. 
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B. SUSAN 



MONTAGE OF SUS^N SEATED AT HER DESK 
STARING STRAIGHT AHEAD. 



SUSAN SMILES SLIGHTLY, LOOKS AROUND 
ROOM, THEN CLOSES HER EYES. 



SUSAN SLUMPED IN CORNER OF THE ROOM 
HIDING HER FACE, CRYING, PUSHING 
OFF TEACHER WHO JS TRYING TO HELP. 

SUS.AN AT DESK.. LOOKS UP INTO CAMERA 
WITH HALF SMILE. 

MOTHER DRAGGING RELUCTANT SUSAN 
DOWN HALL TO CLASSROOM. 



MOTHER DRAGS A FIGHTING SUSAN INTO 
CLASSROOM 



.WHER, FIRM HOLD ON SUS.\N, TALKS 
TO TEACHER 

TEACHER LOOKS l-'ROM MOTHER TO SUSAN 
IN DISBELIEF. 



SUSAN SITTING AT HER DESK STARING 
STRAIGHT ..\HEAD. 



CUPS H/VND TO HER EAR, LISTENS IS 
SCARED /VND HIDES FACE. 

MONTAGE OF CU OF .^WHER ^ND SUS-\N 
IN CONFLICT. 



Tnis is Susan. She's nine years old 
She's rather small for her age... 
delicate, wistful . 

Sometiines. . .very quiet .. .with- 
drawn... at other times suspicious 
frightened. 

And now and then Susan actually 
becomes violently depressed. 



Susan is classified as M-R. But, 
I'm beginning to wonder... 

On her first day in our M-R class, 
she was brought by her mother. It 
was quite a scene. 

It was more than the usual reluc- 
tance of the insecure, self- 
conscious child entering a new and 
suspicious environment... 

Susan's behavior seemed to come as 
no surprise to her mother. 

In fact, the mother explained to 
the teacher that it was quite 
normal. . .for Susan. 

After the moiher left, Susan sat 
at her desk for the r^st of the 
day . 

Except for an occasional apparent 
hallucination, she never moved. 

This kind of behavior went on for 
a week, beginning, each time, with 
a stormy entrance to class with 
her mother. 
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SliOTS Oi'^ STATION WACION ARRIVlNCr 
AND LiriTINC; SUS/VN OUT AT SCHOOL. 



After a week of this, the teacher 
suggested to the mother thai she 
let Susan come to class by herself, 
so.. .Susan was let out at the front 
of the school and walked to class 
alone 



SUSAN srrriNG on wall, paying 

NO ATI'tNTlON TO OrHHR KIDS. 



TEAOil-k SITTING AT DHSK TALKIN(. 
TO KIDS, ZOOM IN ON SUS.AN WORK- 
ING AT \m DESK. , . 



SLOW MOTION 01* SUS.VN RUNNING 
THROUGH ROOM. 



SLOW MOTION OF SUS/V\ THROWING 
PLASTIC BOITLH ON FLOOR, 
SHOTS OF KIDS' REACTIO.N'S. 



She made no friends... in fact, she 
seemed to be completely unaware 
that there were any other children 
around. 

The teacher felt pretty good about 
Susan's change of attitude after 
she began coming to the class alone. 
She actually did some work at her 
desk... until suddenly—one day. 

It was like Susan was in a violent 
little dream world all of her own. 
There didn't seem to be any reason 
for her behavior, and the teacher 
was taken completely by surprise. 
The act didn't seem to be aimed at 
anybody in particular. It was just 
a sudden outburst of venom. 



sus..v\ srrriNG at her desk looking 

OUT WINDOW. 

SUSAN SHOWING TEACHER HER PAPER. 



There were several spells like this 
and they were usually followed by a 
short period of relative calm. 

And Susan would again show some 
interest in her work... 



SUS;\N TALKING TO /XNOTHEk KID .-VND 
LAUGHING. 



and even in some of her classmates. 
However, the '*acting-out'* behavior 
began to dominate and one day I met 
Susan and her teacher in the hall. 



THEY ST.'VND -\ND TALK IN FRONT OF 
SCHOOL, MOTHER ARRIVES .VND SUS;\N 
LEAVES, 



I talked to her for nearly half an 
hour in my office. And we didn't 
really seem to be getting anywhere, 
until we went outside to wait for 
her mother. Then Susan seemed to 
really open up. And when she left, 
I began to wonder who was fooling 
wh o . 
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M0NTAG2 OF SHOTS SHOWING 
DIFFERENT MOODS OF SUSAN 



She was one of the cutest little 
girls I*d ever met»»»and yet, this 
little Jekyll and Hyde had brought 
her EMR teacher to me at the point 
of dispair* 



SPLIT SCREEN STILLS OF SUS.AN, ONE 
SMILING, ONE DEPRESSED, 



C. JOANNA 



SCHOOL PSYCHOLOGIST ENTERS OFFICE 
AND NOTICES JOANNA SITTING IN 
HALL, HEAD IN HANDS, LOOKING DOWN. 



JO.\NNA IS WEARING JE^NS, BOY'S 
SHIRT AND TENNIS SHOES. PSYCHOLO- 
GIST SITS AT DESK AND SPEAKS TO 
HER. SHE GETS UP SLOWLY AND 
STANDS BEFORE HIM, SMUDGE ON HER 
FACE. CAMERA PANS. 



JOANNA ON SCHOOL GROUND, S.AME 
COSTUNE, LAUGHING, RUNNING, 
WRESTLING, .-VND GETTING MAD AND 
CHASING A SMALLER BOY. 



JOANNA DRESSED FOR SCHOOL, EATING 
STAND-UP BREAKFAST IN NESSY 
KITCHEN, SCHOOL BOOKS NEARBY. 
YELLS IN DIRECTION OF BEDROOM 
AND LEAVES, EMPTY LIQUOR BOTTLES 
ON COUNTER. 
CU ON BOTTLE. 

PSYCHOLOGIST AT DESK WORKING, LOOKS 
UP WITH QUIZZICAL EXPRESSION. CUT 
TO JOANNA, MINI SKIRT, TIGHT 
SWEATER, LONGHAIR, MAKE UP, ETC., 
ST.ANDING, SMILING. 



JOAN.NA AT HER DESK IN HH CLASS, 
TEACHER HELPING HER WITH MATH, 
JOANNA VERY BORED. TEACHER LOOKS 
DOWN ;\ND SHAKES HIS HEAD. 

JO.'VNNA WALKING DOWN SCHOOL HALLWAY, 
HIPS SWINGING. 



I remember the first time I had 
occasion to see Joanna in the 
Principal's office. She was 12 
years old and I thought she was 
a boy at first. 

She had been sent to him by her 
home-room teacher because of 
fighting. . .not with other girls 
but with boys. And because she 
was large for her age and strong, 
there weren't many boys who were 
willing to take her on. 

During that first year, I saw her 
several times. She denied discipline 
in the same fashion she denied her 
sex. She talked like a boy, dressed 
like a boy, and acted like a boy. 

Joanna's home-life was a mess. Her 
mother was an alcoholic and her 
father was seldom at home. She was 
an only cliild. 

At the end of that school year she 
and her parents moved away and... 

I didn't see her again for nearly 
two years. *Ihe Principal sent her 
into my office and at first I 
didn't remember ever seeing her 
before. She was completely trans- 
formed, at least physically. She 
was nearly 15 years old and could 
have passed for 18. 

Her counselor had put her in an EH 
class for remedial work in every- 
except social studies. 

According to the reports I received, 
her appearance wasn't the only thing 
that had dianged. 
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JOANNA IN A REGULAR LAB CLASS,,, 
DAYDREAMING, DOODLING ON HER NOTE- 
BOOK, FIDDLING IN HER PURSE, ETC, 



JOANNA IN GIRLS » ROOM APPLYING 
COSMETICS, 



JOANNA LEAVES GIRLS' ROOM AND 
STARTS DOWN CORRIDOR, 



MEETS TWO BOYS AND FLIRTS, BOYS 
WINK KNOWINGLY AT EACH OTHER 
AFTER SHE LEAVES, 

IN CLASSROOM SHE TURNS TO BOY 
ACROSS FROM HER, SMILES AND TALKS, 
MALE TEACHER SPEAKS TO HER FROM 
HIS DESK, SHE GOES UP AND LEANS ON 
DESK COYLY,,, DISS, TO PSYCHOLOGIST'S 
OFFICE, JOANNA SITS IN CHAIR, GOOD 
LEG AND THIGH EXPOSURE, 

WATER DISS, TO JO.^NNA WRESTLING 
WITH BOY 



WATER DISS, TO JOANNA FLIRTING 

MIDDLE-AGED TEACHER AT HER DESK,,, 
JOANNA BRINGS PAPER TO TEACHER, 
TEACHER IS OBVIOUSLY PLEASED AND 
THEY SMILE AT EACH OTHER, 



DISS, TO PSYCHOLOGIST AND OLDER 
TEACHER TALKING IN HIS OFFICE, 



She was in deep academic trouble. She 
simply wouldn't do her school work. 
Except for her social studies class, 
where she got along with her teacher 
very well, she spent most of her time 
either daydreaming or role playing, 

I don't know that she actually 
followed through her role as the 
school sex symbol, but it seemed 
to occupy most of her time and 
energies , 

There were no males in the school 
who didn't come in for their share 
of Joanna's attention. 

On the school ground,,. 



In the classroom. , , 

THE TEACHERS,,, the male teachers, 
I should say , , , 

Even me. 



She had completely changed from the 
little girl who took out all of her 
aggressions on the male population 
at age 12, 

•,,to an overly-developed teen-ager 
whose sole interest seemed to be 
that same male population. And yet, 
the one inconsistency was her class 
in social studies, taught by a 
middle-aged woman, and in which 
Joanna not only did well,,, but 
seemed to have a genuine affection 
for the teacher, 

I talked with her social studies 
teacher. She was convinced that 
there was nothing wrong,,, that the 
other teachers just didn't know how 
to communicate with Joanna, 
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DISS. TO PSYCHOLOGIST TALKING TO 
EH TEACHER IN HER CLASSROOM. 



THREE SHOT, EH TEACHER, OLDER 
TEACHER, AND PSYCHOLOGIST TALKING 
IN HIS OFFICE. PSYCHOLOGIST 
LISTENING AND LOOKING FROM ONE 
TO THE OTHER. 



And I talked with her special EH 
class teacher... he was convinced 
that Joanna's refusal to do any 
of her work was symptomatic of a 
very deep emotional disturbance. 

And I held several conferences 
with both of her teachers .. .the EH 
teacher who thought Joanna was 
impossible, and the social studies 
teacher who thought Joanna was very 
misunderstood. 

Actually— both of these teachers 
may be PARTIALLY RIGHT, but neither 
one seemed to have an answer to 
the problem. 



JOANNA AND BOY WALKING AWAY FROM What to do about Joanna? 

SCHOOL. BOY OFFERS HER A CIGARETTE, 
SHE SMILES AT HIM AS HE LIGHTS IT 
FOR HER. 
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Appendix B-1 

SUGGESTED ANALYSES OF CONSULTEE FORMS 

Staff Development - Agency* Centered 



To be used by the consultant or the CMHC evaluation staff 



1. Consultant-consultee agreement, using Item I of 
Consultee Expectations (Form AC-2) and Item I of 
Consultant Expectations (Form AC-3). Include added 
statements in this analysis. Special attention should 
be given to the outcome of statement 4 and added 
others to note whether the consultee still has miscon- 
ception about the purpose of consultation. 

A. PLUS (Agreement) 

(1) Number of statements marked expected 
by both consultant and consultee. 

(2) Number of statements marked not expected 
by both consultant and consultee. 



AGREEMENT: 



b. MINUS 



(1) Number of statements marked expected by 
consultant, not expected by consultee. 

(2) Number of statements marked not expected 
by consultant, expected by consultee. 

DISCREPANCY: 



Consultee 
Y 



TOTAL 



Note: The overall picture and the area and number of discrepancies are probably more significant than 
the arithmetic balance. As cases build up, numbers might be converted to percentages. 

2. Comparison of Consultee Expectation and Final 
Evaluation, using Item I of Consultee Expectations 
(Form AC-2) and Item I of Consultee Final 
Evaluation (Form AC-7) (excluding statement 4 and 
other added statements which the consultant feels 
are clear misconceptions on the part of the consultee. 
Also exclude those instances where none or slight 
IS checked on both forms). 
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A. PLUS 

(1) Number of statements checked at same or 
higher level on final evaluation than on 
expectation 

B. MINUS 

(1) Number of statements checked at lower 
level on final evaluation than on 
expectations. 

3. Consultees' critique of the consultation series, using 
Item II of Consultee Final Evaluation (Form AC-7). 

A. Number of statements checked by each 
consultee in each category: 

Statement Content 

Al, A2, A3 Consultant's acquaintance with 
school 

B, C Composition of group 

D, E, F, G, Consultant 
H, I characteristics 

J Consultee preparation 

K Consultee characteristics 

TOTAL. 

4. Consultees' motivation for continuing, using Item III 
of Consultee Final Evaluation (Form AC-7). 

Enter number of statements checked as 
important in any degree . 

A. Learned 

B. Stimulated 

C. Interest in changes 

D. Committed 

E. Please consultant 

5. Consultees' overall opinion of consultation, using 
Item IV of Consultee Final Evaluation. (Tabulate 
"Yes" answers.) 

6. Number of hours spent in consultation and related 
activities. (Item V Form AC 7.) (Tabulate number 
of hours.) 

1. Critique of consultation by those discontinuing, 
using Survey of Those Discontinuing Cons ultation. 
(Form CC-9) 
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Consul tee 

X Y Z TOTAL 



A. Number of statements checked in each 
category by consul tee dropout. 

Statement Content 

1 Beyond control 

2, 3, 10 Consul tee characteristics 

4, 5 Consultant's acquaintance 

with school 

7, 8, 1 1 Consultant characteristics 

6, 9 Group characteristics 



TOTAL. 



r 
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Appendix B-2 

SUGGESTED ANALYSES OF CONSULTANT FORMS 

Staff Development - Agency-Centered 

1. Consultant-consultee agreement following negotiation. 
(Example 1, Appendix A-1). 

2. Copsultee goal achievement as judged by consultant, using Item I of 
Consultant Expectation (Form AC-3) and Item I of Consultant 
Final Evaluation (Form AC-6). 

A. PLUS 

Number of statements checked at same or higher level on Final Evaluation. 

B. MINUS 

Number of statements checked at higher level on Expectation. 

3. Consultant satisfaction that CMHC goals are attained, using Item II 
of Consultant Expectations (Form AC-3) and Item II of Consultant 
Final Evaluation (Form AC-6|. 

A. PLUS 

Number of statements checked at same or higher level on Final Evaluation. 

B. MINUS 

Number of statements checked at higher level on Expectation. 

C. Unplanned benefits, i.e., number of additional benefits introduced 
on the Consultant Final Evaluation form. 

4. Critique of consultation by consultant 

A simple tally of Item III, Consultant Final Evaluation (Form AC-6), 
is all that is required. 
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